-- Logs begin at Wed 2021-12-15 15:29:00 UTC, end at Wed 2021-12-15 16:24:44 UTC. -- Dec 15 15:59:10.863444 dv-cinder-800703-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 15:59:10.872762 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 15:59:10 2021] *** Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: nodename: dv-cinder-800703-3-iscsi Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: machine: x86_64 Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: clock source: unix Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: pcre jit disabled Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: detected number of CPU cores: 4 Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: current working directory: / Dec 15 15:59:10.874735 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: detected binary path: /usr/bin/uwsgi-core Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: your processes number limit is 47680 Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: your memory page size is 4096 bytes Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: detected max file descriptor number: 2048 Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: lock engine: pthread robust mutexes Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: thunder lock: enabled Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 15:59:10.875423 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 15:59:10.918753 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: Python main interpreter initialized at 0x5611b3c2e9c0 Dec 15 15:59:10.918753 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: python threads support enabled Dec 15 15:59:10.918753 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: your server socket listen backlog is limited to 100 connections Dec 15 15:59:10.918753 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: your mercy for graceful operations on workers is 90 seconds Dec 15 15:59:10.919065 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 15:59:10.919137 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: *** Operational MODE: preforking *** Dec 15 15:59:10.919400 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: *** uWSGI is running in multiple interpreter mode *** Dec 15 15:59:10.919400 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: spawned uWSGI master process (pid: 101855) Dec 15 15:59:10.919572 dv-cinder-800703-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 15:59:10.921072 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: spawned uWSGI worker 1 (pid: 101856, cores: 1) Dec 15 15:59:10.921072 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: spawned uWSGI worker 2 (pid: 101857, cores: 1) Dec 15 15:59:10.921072 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 15:59:12.640309 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:59:12.640309 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: from cryptography.utils import int_from_bytes Dec 15 15:59:12.640896 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:59:12.640896 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: from cryptography.utils import int_from_bytes Dec 15 15:59:12.641400 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:59:12.641400 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: from cryptography.utils import int_from_bytes Dec 15 15:59:12.641874 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:59:12.641874 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: from cryptography.utils import int_from_bytes Dec 15 15:59:15.222955 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 15:59:15.223507 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 15:59:15.223616 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 15:59:15.223616 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 15:59:15.224028 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 15:59:15.224107 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 15:59:15.224180 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 15:59:15.224255 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 15:59:15.224320 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 15:59:15.224583 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 15:59:15.224682 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.224938 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.225031 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.225255 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.225353 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.225599 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.225689 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.225926 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226014 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226260 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226353 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226583 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226671 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226897 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.226991 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.227215 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.227311 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.227473 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.227558 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.227784 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.227885 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.228097 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.228183 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-3-iscsi {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.228415 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.228508 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-3-iscsi {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.228722 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.228818 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229034 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229121 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229348 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229442 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229650 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229748 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.229963 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.230061 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.230291 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.230390 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.230607 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.230785 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.231111 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.231252 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.231423 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.231551 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.231731 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.231852 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.232051 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.232175 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.232383 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.232480 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.232699 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.232792 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233010 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233103 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233332 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233472 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233648 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233741 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.233954 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.234045 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.234294 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.234404 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-3-iscsi {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.234693 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-3-iscsi {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.234784 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.235004 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.235091 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.235318 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.235404 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.235633 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.235773 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236024 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236110 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236332 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236434 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236642 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236731 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.236959 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.237052 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.237268 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.237398 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.237594 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.237689 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.237913 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238006 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238256 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238360 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238576 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238662 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238880 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.238976 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.239187 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.239274 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.239493 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.239579 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.239802 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.239901 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240106 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240245 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240405 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240560 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240648 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240867 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.240955 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.241652 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.241775 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.241968 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.242107 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.242332 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.242425 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.242658 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.242746 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.242910 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243006 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243226 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243313 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243479 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243567 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243802 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.243897 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.244126 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.244220 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.244429 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.244525 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.244735 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.244824 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245039 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245126 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245344 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245439 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245648 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245737 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.245950 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.246037 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.246282 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.246390 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.246596 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.246692 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.246917 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247003 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247228 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247323 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247549 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247637 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247859 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.247945 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.248184 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.248288 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.248491 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.248577 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.248830 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.248924 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.249142 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.249237 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.249451 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.249537 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.249770 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.249863 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.250089 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.250259 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.250420 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.250508 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.250726 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.250814 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251033 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251128 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251350 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251438 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251658 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251745 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.251972 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252059 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252223 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252309 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252521 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252611 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252824 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.252914 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.253130 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.253224 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.253433 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.253519 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.253736 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.253825 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254041 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254129 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254364 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254465 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254669 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254757 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.254970 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255062 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255273 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255371 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255577 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255670 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255883 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.255977 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.256183 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.256280 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.256488 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.256581 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.257391 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.257500 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.257701 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.258007 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.258106 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.258353 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.258550 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.258649 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.258937 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259026 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259245 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259338 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259556 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259657 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259877 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.259975 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.260184 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.260273 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.260488 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.260580 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.260801 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.260896 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.261104 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.261192 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.261407 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.261496 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.261723 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.261822 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262031 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262119 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262358 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262455 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262672 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262760 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.262969 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263056 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263277 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263364 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263592 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263681 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263896 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.263985 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.264201 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.264294 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.264503 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.264592 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.264806 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.264893 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.265109 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.265196 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.265414 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.265504 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.265716 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.265813 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266017 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266113 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266339 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266439 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266648 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266734 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.266956 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267052 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267261 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267347 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267565 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267651 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267865 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.267963 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.268182 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.268275 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.268500 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.268598 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.268813 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.268909 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.269122 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.269216 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.269447 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:59:15.269536 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.269784 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.269881 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.270115 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.270247 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.270462 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.270557 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.270775 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.270863 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.271088 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.271183 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.271412 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.271501 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.271724 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.271813 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272034 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272122 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272365 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272461 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272683 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272771 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.272999 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.273085 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.273325 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.273421 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.273639 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.273732 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.273953 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.274060 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.274291 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.274392 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.274603 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.274698 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.274919 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275013 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275239 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275339 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275555 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275642 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275863 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.275957 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.276182 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.276281 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.276521 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.276622 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.276826 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.276922 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.277139 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.277234 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.277450 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.277546 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.277771 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.277896 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.278083 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.278200 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.278418 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.278558 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.278730 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.278819 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279058 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279155 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279372 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279460 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279685 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279779 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.279999 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.280088 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.280322 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.280408 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.280635 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.280730 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.280950 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281043 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281252 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281340 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281556 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281651 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281865 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.281954 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.282193 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.282295 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.282508 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.282605 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.282813 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.282900 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.283122 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.283253 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.283430 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.283530 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.283741 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.283827 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284049 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284136 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284356 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284452 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284657 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284745 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.284967 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285054 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285274 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285374 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285576 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285663 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285880 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.285966 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.286215 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.286308 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.286523 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.286611 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.286839 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.286944 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.287139 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.287231 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.287443 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.287538 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.287754 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.287847 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.288089 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.288177 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.288399 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.288488 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.288706 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.288796 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289024 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289121 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289332 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289419 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289645 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289740 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.289961 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.290049 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.290312 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.290474 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.290618 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.290713 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.290933 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291038 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291255 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291341 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291571 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291668 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291877 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.291972 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.292191 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.292279 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.292497 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.292596 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.292801 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.292932 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.293102 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.293190 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.293411 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.293510 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.293713 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.293802 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294015 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294103 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294341 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294432 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294644 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294733 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.294947 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295041 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295254 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295342 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295563 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295649 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295866 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.295953 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.296169 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.296265 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.296472 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.296560 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.296795 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.296894 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.297105 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.297192 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.297413 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.297508 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.297722 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.297818 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.298067 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.298172 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.298401 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.298510 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.298713 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.298815 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299028 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299116 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299341 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299429 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299657 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299756 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.299968 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.300062 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.300278 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.300366 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.300598 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.300687 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.300911 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.301002 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.301223 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.301310 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.301813 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.301904 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.302136 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.302241 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.302469 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.302556 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.302787 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.302876 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.303094 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.303193 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.303411 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.303500 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.304247 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.304371 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.304578 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.304665 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.304887 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.304975 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.305208 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.305297 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.305515 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.305600 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.305831 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.305926 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.306140 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.306305 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.306508 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.306608 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.306783 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.306881 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.307093 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.307188 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.307411 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.307498 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.307721 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.307825 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308035 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308122 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308345 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308432 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308665 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308759 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.308973 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309066 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309289 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309375 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309593 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309681 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309911 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.309998 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.310246 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.310336 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.310570 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.310666 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.310879 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.310973 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.311190 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.311277 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.311512 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.311601 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.311824 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.311910 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.312133 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.312220 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.312444 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.312533 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.312751 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.312838 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313057 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313155 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313368 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313455 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313680 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313766 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.313989 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.314087 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.314319 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.314406 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.314628 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.314716 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.314941 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.315037 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.315249 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.315337 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.315553 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.315640 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.315856 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316021 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316166 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316260 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316477 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316564 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316788 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.316885 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.317097 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.317185 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.317413 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.317500 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.317716 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.317804 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318021 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318107 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318366 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318454 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318677 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318767 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.318981 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.319068 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.319826 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.319934 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.320136 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.320226 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.320451 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.320538 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.320761 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.320848 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321067 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321154 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321373 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321466 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321688 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321787 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.321998 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.322086 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.322336 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.322425 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.322646 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.322746 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.322954 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323043 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323267 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323353 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323578 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323672 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323886 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.323973 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.324194 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.324289 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.324501 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.324596 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.324811 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.324902 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.325119 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.325214 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.325427 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.325516 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.325737 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.325824 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326046 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326139 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326378 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326467 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326684 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326779 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.326994 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.327081 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.327305 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.327393 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.327619 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.327869 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.327957 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.328206 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.328303 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.328525 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.328617 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.328848 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.329085 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.329182 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.329421 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.329509 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.329739 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.329825 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.330058 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.330175 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.330440 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.330526 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.330748 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.330847 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331060 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331198 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331366 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331455 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331669 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331756 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.331981 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332077 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332286 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332374 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332591 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332714 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332895 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.332983 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.333205 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.333298 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.333506 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.333592 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.333808 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.333900 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.334112 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.334259 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.334453 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.334550 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.334780 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.334879 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.335086 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.335174 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.335397 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.335486 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.335699 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.335797 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336018 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336117 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336324 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336410 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336628 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336723 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.336931 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337020 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337232 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337319 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337550 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337636 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337856 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.337944 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.338184 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.338319 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.338496 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.338609 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.338843 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.338941 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.339151 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.339247 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.339454 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.339561 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.339780 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.339882 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.340091 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.340184 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.340394 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.340560 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.340704 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.340797 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341009 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341103 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341323 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341434 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341624 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341721 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.341934 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342037 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342265 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342360 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342575 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342680 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342898 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.342997 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.343192 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.343288 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.343501 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.343630 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.343812 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.343910 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.344120 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.344215 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.344425 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.344517 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.344726 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.344819 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345029 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345123 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345339 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345434 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345645 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345739 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.345945 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346044 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346269 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346364 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346570 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346671 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346884 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.346976 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.347186 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.347280 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.347489 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.347609 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.347790 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.347884 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.348098 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.348196 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.348401 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.348502 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.348700 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.348792 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349002 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349094 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349314 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349419 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349614 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349708 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.349916 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350008 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350241 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350337 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350570 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350667 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350873 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.350974 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.351178 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.351272 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.351491 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.351613 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.351797 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.351898 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.352096 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.352189 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.352405 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.352499 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.352710 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.352802 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353014 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353110 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353318 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353411 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353618 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353723 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.353923 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354028 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354243 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354332 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354548 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354653 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354850 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.354941 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.355150 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.355245 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.355455 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.355551 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.355764 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.355851 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356063 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356151 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356365 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356462 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356666 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356761 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.356987 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.357073 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.357293 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.357382 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.357602 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.357691 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.357909 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358009 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358258 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358355 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358575 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358662 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358884 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.358970 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.359195 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.359285 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.359503 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.359590 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.359805 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.359894 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.360124 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.360214 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.360434 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.360522 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.360745 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.360841 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361049 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361138 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361351 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361445 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361666 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361761 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.361972 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.362059 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.362303 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.362395 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.362613 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.362711 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.362935 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363045 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363250 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363348 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363548 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363644 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363856 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.363948 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.364163 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.364254 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.364470 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.364566 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.364778 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.364866 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.365085 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.365173 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.365394 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.365484 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.365704 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.365791 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.366537 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.366634 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.366868 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.366958 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.367180 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.367268 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.367485 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.367573 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.367795 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.367892 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.368105 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.368194 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.368409 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.368497 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.368716 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.368805 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369028 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369115 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369333 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369493 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369640 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369727 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.369942 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.370027 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.370274 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.370384 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.370587 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.370685 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.370900 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371009 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371209 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371310 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371523 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371612 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371831 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.371923 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.372206 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.372301 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.372516 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.372605 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.372832 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.372926 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.373143 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.373250 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.373448 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.373540 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.373761 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.373890 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.374082 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.374247 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.374428 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.374517 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.374738 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.374826 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.375071 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.375158 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.375375 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.375469 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.375684 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.375772 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376008 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376105 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376313 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376407 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376618 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376715 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.376922 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377009 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377244 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377331 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377549 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377647 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377854 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.377948 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.378189 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.378291 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.378511 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.378608 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.378820 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.378908 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.379144 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.379284 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.379582 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.379677 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.379892 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.379978 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.380199 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.380285 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.380528 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.380622 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.380852 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.380940 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.381153 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.381240 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.381463 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.381552 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.382327 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.382453 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.382657 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.382788 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.382981 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.383099 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.383293 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.383419 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.383608 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.383734 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.383914 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.384061 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.384234 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.384388 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.384556 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.384705 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.384870 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.385028 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.385193 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.385337 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.385607 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.385703 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.385933 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.386022 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.386264 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.386355 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.386585 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.386710 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.386928 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387034 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387220 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387342 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387523 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387659 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387833 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.387985 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.388138 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.388315 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.388442 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.388627 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.388765 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.388937 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389070 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389252 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389381 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389561 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389691 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389870 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.389999 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.390219 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.390324 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.390533 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.390634 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.390848 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.390937 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.391165 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.391253 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.391480 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.391578 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.391788 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.391876 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.392097 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.392184 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.392423 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.392518 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.392731 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.392826 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393049 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393135 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393361 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393458 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393667 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393758 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.393970 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.394101 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.394324 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.394415 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.394669 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.394756 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.394975 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.395064 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.395295 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.395391 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.395604 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.395691 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.395914 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396010 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396239 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396332 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396555 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396642 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396879 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.396976 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.397195 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.397301 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.397537 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.397626 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.397863 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.397960 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.398263 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.398356 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.398496 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.398586 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.398810 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.398910 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.399115 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.399203 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.399420 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.399509 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.399724 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.399820 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400033 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400129 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400336 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400425 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400643 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400739 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.400945 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401033 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401262 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401350 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401563 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401651 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401867 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.401954 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.402192 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.402284 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.402500 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.402589 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.402807 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.402899 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.403109 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.403205 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.403431 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.403518 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.403737 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.403825 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404043 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404189 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404353 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404477 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404660 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404749 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.404994 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.405091 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.405302 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.405397 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.405622 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.405716 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.405937 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.406035 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.406276 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.406367 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.406593 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.406703 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.406909 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407006 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407223 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407309 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407538 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407627 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407854 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.407943 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.408161 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.408256 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.408476 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.408564 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.408788 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.408876 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.409102 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.409191 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.409420 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.409616 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.409751 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.409945 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.410041 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.410286 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.410378 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.410606 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.410710 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.410921 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.411173 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.411263 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.411508 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.411610 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.411826 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.411915 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.412135 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.412222 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.412445 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.412542 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.412754 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.412846 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.413092 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.413187 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.413407 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.413505 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.413720 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.413808 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.414033 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.414121 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.414372 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.414464 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.414685 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.414775 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415000 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415088 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415317 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415408 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415657 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415751 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.415971 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.416066 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.416276 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.416365 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.416588 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.416685 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.416901 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417031 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417214 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417310 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417525 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417614 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417835 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.417925 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.418147 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.418247 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.418484 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.418584 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.418794 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.418888 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.419103 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.419191 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.419416 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.419503 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.419728 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.419816 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420044 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420130 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420361 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420458 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420675 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420764 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.420985 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.421072 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.421298 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.421395 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.421614 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.421703 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.421949 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.422126 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.422297 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.422466 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.422618 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.422798 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.422936 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.423122 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.423254 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.423446 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.423765 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.423888 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.424084 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.424178 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.424410 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.424498 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.424734 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.424859 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425021 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425109 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425333 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425423 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425642 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425739 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.425948 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.426037 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.426295 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.426654 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.426880 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.426969 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.427182 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.427281 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.427499 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.427587 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.427807 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.427903 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.428130 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.428339 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.428429 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.429204 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.429296 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.429527 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.429623 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.429856 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.429947 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.430205 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.430418 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.430528 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.430766 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.430865 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.431086 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.431175 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.431418 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.431506 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.431747 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.431837 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432063 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432151 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432368 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432462 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432671 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432767 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.432978 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.433070 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.433285 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.433374 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.433592 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.433680 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.433898 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434030 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434223 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434315 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434532 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434620 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434843 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.434932 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.435151 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.435247 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.435456 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.435544 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.435757 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.435844 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436070 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436166 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436375 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436464 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436679 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436776 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.436982 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437084 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437286 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437374 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437596 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437684 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437898 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.437999 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.438225 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.438329 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.438530 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.438617 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.438875 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.438964 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.439132 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.439244 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.439437 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.439527 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.439738 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.439827 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440045 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440134 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440347 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440435 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440650 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440748 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.440961 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441056 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441268 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441359 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441589 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441679 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441893 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.441981 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.442221 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.442325 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.442568 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.442658 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.442884 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.443021 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.443221 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.443410 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.443536 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.443835 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.443933 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.444114 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.444773 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.445008 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.445099 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.445347 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.445622 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.445712 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.445945 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.446042 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.446278 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.446370 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.446602 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.446709 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.446912 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447005 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447222 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447318 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447531 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447660 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447842 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.447938 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.448149 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.448247 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.448459 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.448548 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.448767 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.448858 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.449077 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.449173 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.449386 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.449475 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.449699 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.449798 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.450037 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.450126 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.450378 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.450480 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.450697 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.450786 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451010 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451098 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451323 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451419 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451634 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451723 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.451943 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452033 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452250 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452352 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452558 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452647 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452874 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.452963 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.453186 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.453278 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.453500 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.453599 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.453801 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.453900 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.454111 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.454225 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.454454 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.454543 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.454786 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.454875 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.455106 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.455209 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.455414 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.455511 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.455754 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.455854 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.456077 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.456167 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.456387 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.456483 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.456704 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.456802 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457013 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457110 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457341 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457430 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457677 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457778 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.457990 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.458079 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.458337 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.458444 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.458642 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.458733 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.458946 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.459034 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.459247 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.459335 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.459554 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.459644 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.460392 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.460490 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.460723 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.460812 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461038 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461138 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461346 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461436 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461656 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461756 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.461977 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.462066 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.462306 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.462410 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.462627 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.462729 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.462947 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463035 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463258 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463347 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463566 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463664 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463883 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.463972 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.464191 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.464325 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.464502 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.464605 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.464812 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.464909 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.465118 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.465207 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.465426 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.465516 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.465733 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.465821 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.466053 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.466140 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.466396 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.466487 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.466699 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.466797 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467009 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467108 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467321 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467412 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467635 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467721 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.467947 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468043 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468256 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468352 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468581 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468668 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468887 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.468986 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.469201 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.469297 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.469509 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.469599 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.469818 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.469919 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.470133 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.470260 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.470468 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.470566 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.470784 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.470873 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.471099 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.471187 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.471414 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.471501 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.471733 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.471834 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.472051 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.472146 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.472378 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.472472 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.472707 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.472795 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473078 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473173 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473349 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473441 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473660 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473757 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.473962 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.474059 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.474229 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 15:59:15.474357 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.474693 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.475012 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.475329 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.476205 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:59:15.476451 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 15:59:15.497284 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_db.sqlalchemy.engines [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.498520 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.563040 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.context [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cda00ea0-fd54-437b-b7c8-456fcc486c03(cell1) {{(pid=101856) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 15:59:15.563625 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.context [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cda00ea0-fd54-437b-b7c8-456fcc486c03(cell1) {{(pid=101857) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 15:59:15.567318 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 15:59:15.567899 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 15:59:15.568880 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 15:59:15.569995 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 15:59:15.570234 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 15:59:15.570832 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 15:59:15.572161 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 15:59:15.572751 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_concurrency.lockutils [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 15:59:15.582487 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_db.sqlalchemy.engines [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.585876 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.588506 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.593106 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_db.sqlalchemy.engines [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.750773 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_db.sqlalchemy.engines [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:15.753485 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG oslo_db.sqlalchemy.engines [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:59:16.097647 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 15:59:16.098792 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: WARNING keystonemiddleware.auth_token [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 15:59:16.104287 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 15:59:16.105648 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: WARNING keystonemiddleware.auth_token [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 15:59:16.446556 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 15:59:16.451086 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: WARNING keystonemiddleware.auth_token [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 15:59:16.452021 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: WARNING keystonemiddleware.auth_token [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 15:59:16.456400 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: WARNING keystonemiddleware.auth_token [None req-97f16745-f00c-4e94-9978-1aa88c66f48d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 15:59:16.457070 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611b3c2e9c0 pid: 101857 (default app) Dec 15 15:59:16.459151 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 15:59:16.460879 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002294 Dec 15 15:59:16.461289 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Wed Dec 15 15:59:16 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 15:59:16.462074 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611b3c2e9c0 pid: 101856 (default app) Dec 15 16:00:38.052806 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:38.054470 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Dec 15 16:00:38.054881 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:38.478411 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-79e71f76-91cf-4da4-931c-ee99b26abd10 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:38.508320 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-79e71f76-91cf-4da4-931c-ee99b26abd10 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.445788 Dec 15 16:00:38.509303 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Wed Dec 15 16:00:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:00:40.921702 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:40.922642 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-172ef12c-5247-49a3-ab7e-8464e0ebde7d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Dec 15 16:00:40.923021 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:40.990970 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-19116581-c4e2-44b9-b977-6742e5c95cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:41.009178 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:00:41.009178 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: warnings.warn(msg) Dec 15 16:00:41.038198 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-19116581-c4e2-44b9-b977-6742e5c95cc4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107305 Dec 15 16:00:41.042194 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:40 2021] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:41.263669 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-1718cc5b-9885-4647-99c5-9ab9486621e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:41.265889 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:00:41.265889 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: warnings.warn(msg) Dec 15 16:00:41.316324 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-1718cc5b-9885-4647-99c5-9ab9486621e4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.268547 Dec 15 16:00:41.323326 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Wed Dec 15 16:00:41 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:00:43.738692 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-19116581-c4e2-44b9-b977-6742e5c95cc4 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:43.741061 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-19116581-c4e2-44b9-b977-6742e5c95cc4 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002868 Dec 15 16:00:43.741598 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:43 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:43.856133 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-b0bfe51f-e10c-42e3-9c23-ae9c6ec5bec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:43.879403 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:00:43.879403 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: warnings.warn(msg) Dec 15 16:00:43.900157 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-b0bfe51f-e10c-42e3-9c23-ae9c6ec5bec6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151650 Dec 15 16:00:43.906241 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:43.914099 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-3581c948-3739-4b0d-b838-76da0ee06e1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:43.915606 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:00:43.915606 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: warnings.warn(msg) Dec 15 16:00:43.949196 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-3581c948-3739-4b0d-b838-76da0ee06e1e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038613 Dec 15 16:00:43.949772 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Wed Dec 15 16:00:43 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:00:46.361398 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-b0bfe51f-e10c-42e3-9c23-ae9c6ec5bec6 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:46.362554 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-b0bfe51f-e10c-42e3-9c23-ae9c6ec5bec6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 15 16:00:46.363003 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:46.428510 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-1695b138-0506-4e87-a438-613d66c833ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:46.449414 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-1695b138-0506-4e87-a438-613d66c833ed admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080062 Dec 15 16:00:46.450077 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:46.462802 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-5b6fe8da-1827-4496-997e-f2808a42df3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:46.486795 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-5b6fe8da-1827-4496-997e-f2808a42df3d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027679 Dec 15 16:00:46.487958 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Wed Dec 15 16:00:46 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:00:48.896588 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-1695b138-0506-4e87-a438-613d66c833ed admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:48.897629 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-1695b138-0506-4e87-a438-613d66c833ed admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 15 16:00:48.898059 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:48.955487 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-623f5cde-d2f9-4f3a-b61f-d43a622502dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "name": "ds2G", "vcpus": 2}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:48.972907 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-623f5cde-d2f9-4f3a-b61f-d43a622502dd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068649 Dec 15 16:00:48.973729 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:48.985307 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-77e3655a-3ef8-429e-ad47-f7cebe09da4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:49.008215 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-77e3655a-3ef8-429e-ad47-f7cebe09da4b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026381 Dec 15 16:00:49.009010 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Wed Dec 15 16:00:48 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:00:51.431821 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-623f5cde-d2f9-4f3a-b61f-d43a622502dd admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:51.432830 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-623f5cde-d2f9-4f3a-b61f-d43a622502dd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 15 16:00:51.433232 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:51.493257 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-94a7960d-aea3-4565-8516-3117f6446222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:51.514051 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-94a7960d-aea3-4565-8516-3117f6446222 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074231 Dec 15 16:00:51.514933 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:51.527494 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-62b88beb-47a7-4c16-b9c9-d563a40533cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:51.554591 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-62b88beb-47a7-4c16-b9c9-d563a40533cd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030617 Dec 15 16:00:51.560687 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Wed Dec 15 16:00:51 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:00:54.130812 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-94a7960d-aea3-4565-8516-3117f6446222 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:54.131838 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-94a7960d-aea3-4565-8516-3117f6446222 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Dec 15 16:00:54.132243 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:54.200113 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-c1c2d4a5-241f-4de9-aa18-9e1a5d7065af admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:54.222826 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-c1c2d4a5-241f-4de9-aa18-9e1a5d7065af admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084062 Dec 15 16:00:54.223360 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Wed Dec 15 16:00:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:00:56.742102 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-94a7960d-aea3-4565-8516-3117f6446222 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:56.743143 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-94a7960d-aea3-4565-8516-3117f6446222 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 15 16:00:56.743540 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:56.808222 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-368977ef-4128-4e8c-94a9-4533e390fd32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:56.827265 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-368977ef-4128-4e8c-94a9-4533e390fd32 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077321 Dec 15 16:00:56.827773 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:56 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:56.839942 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-1cf0ff28-e9b8-4c51-91c6-a0a08fb42626 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:56.863867 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-1cf0ff28-e9b8-4c51-91c6-a0a08fb42626 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027600 Dec 15 16:00:56.864433 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Wed Dec 15 16:00:56 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:00:59.220085 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-368977ef-4128-4e8c-94a9-4533e390fd32 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:00:59.221642 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-368977ef-4128-4e8c-94a9-4533e390fd32 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 15 16:00:59.222335 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:00:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:00:59.280149 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-bb0075e3-6d01-4bb5-84ca-19a3fbd4416a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:59.297811 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-bb0075e3-6d01-4bb5-84ca-19a3fbd4416a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069427 Dec 15 16:00:59.298556 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:00:59 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:00:59.311434 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-872043d0-23ff-435c-a169-2a6c37d7e52b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:00:59.333972 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-872043d0-23ff-435c-a169-2a6c37d7e52b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026105 Dec 15 16:00:59.334578 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Wed Dec 15 16:00:59 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:01:01.735672 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-bb0075e3-6d01-4bb5-84ca-19a3fbd4416a admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:01.737297 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-bb0075e3-6d01-4bb5-84ca-19a3fbd4416a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Dec 15 16:01:01.737781 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:01:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:01.799509 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-3458fc3e-82b2-4036-9c30-25f3267b1938 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "ram": 4096, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:01.818884 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-3458fc3e-82b2-4036-9c30-25f3267b1938 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074596 Dec 15 16:01:01.834498 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:01:01 2021] POST /compute/v2.1/flavors => generated 406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:01:01.839253 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-16983401-287a-412f-a5fb-52e93a09baa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:01.865368 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-16983401-287a-412f-a5fb-52e93a09baa3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026944 Dec 15 16:01:01.866189 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Wed Dec 15 16:01:01 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:01:04.299766 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-3458fc3e-82b2-4036-9c30-25f3267b1938 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:04.300866 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-3458fc3e-82b2-4036-9c30-25f3267b1938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Dec 15 16:01:04.301351 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:01:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:04.363886 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-d97ae419-3ca9-4e01-aa02-49b5664d7277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:04.383029 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-d97ae419-3ca9-4e01-aa02-49b5664d7277 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075181 Dec 15 16:01:04.383926 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:01:04 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:01:04.396603 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-692076cc-5beb-4d29-8bcc-1683ae8454d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:04.420701 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-692076cc-5beb-4d29-8bcc-1683ae8454d0 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028271 Dec 15 16:01:04.421365 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Wed Dec 15 16:01:04 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:01:06.942618 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-d97ae419-3ca9-4e01-aa02-49b5664d7277 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:06.943635 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-d97ae419-3ca9-4e01-aa02-49b5664d7277 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Dec 15 16:01:06.944061 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:01:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:07.010510 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7038558a-087f-4b67-9f3f-d30ef32cd54a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:07.031553 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7038558a-087f-4b67-9f3f-d30ef32cd54a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081141 Dec 15 16:01:07.032100 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Wed Dec 15 16:01:06 2021] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:01:07.048627 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-0a24ceac-3b6e-4d9e-abd0-bace15e5a11e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:07.077792 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-0a24ceac-3b6e-4d9e-abd0-bace15e5a11e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033803 Dec 15 16:01:07.079162 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Wed Dec 15 16:01:07 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:01:27.970779 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7038558a-087f-4b67-9f3f-d30ef32cd54a admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:27.971767 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7038558a-087f-4b67-9f3f-d30ef32cd54a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Dec 15 16:01:27.972162 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:01:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:28.028618 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-50770ba8-b330-45f3-a4f6-99b8ff52fcf6 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:28.045510 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-50770ba8-b330-45f3-a4f6-99b8ff52fcf6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066774 Dec 15 16:01:28.046020 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Wed Dec 15 16:01:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:01:29.625286 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7038558a-087f-4b67-9f3f-d30ef32cd54a admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:29.626334 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7038558a-087f-4b67-9f3f-d30ef32cd54a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Dec 15 16:01:29.626765 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:29.815244 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-71f88172-f956-4381-a495-fbb57b807a78 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:29.820580 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.wsgi [None req-71f88172-f956-4381-a495-fbb57b807a78 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:01:29.821146 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-71f88172-f956-4381-a495-fbb57b807a78 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:01:29.821942 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-71f88172-f956-4381-a495-fbb57b807a78 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056770 Dec 15 16:01:29.822472 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Wed Dec 15 16:01:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:29.832780 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7ceaad1e-0a5f-4320-a3a3-42b1f3af8a41 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:29.852586 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7ceaad1e-0a5f-4320-a3a3-42b1f3af8a41 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023994 Dec 15 16:01:29.853116 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Wed Dec 15 16:01:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:01:29.862929 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-e17f88f7-70c8-486b-b277-36a9fa05d2ba admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:29.883976 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-e17f88f7-70c8-486b-b277-36a9fa05d2ba admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024433 Dec 15 16:01:29.884496 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Wed Dec 15 16:01:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:01:29.894561 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7182795e-a645-4c9e-8c11-97547200b2f4 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:29.899851 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.wsgi [None req-7182795e-a645-4c9e-8c11-97547200b2f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:01:29.900408 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-7182795e-a645-4c9e-8c11-97547200b2f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:01:29.901181 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-7182795e-a645-4c9e-8c11-97547200b2f4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010719 Dec 15 16:01:29.901661 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Wed Dec 15 16:01:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 16:01:31.374752 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-e17f88f7-70c8-486b-b277-36a9fa05d2ba admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:31.376245 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-e17f88f7-70c8-486b-b277-36a9fa05d2ba admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Dec 15 16:01:31.376645 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:31.564924 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-16e225fd-d3eb-4c6d-81f8-e5d5958736c1 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:31.570719 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.wsgi [None req-16e225fd-d3eb-4c6d-81f8-e5d5958736c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:01:31.571281 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-16e225fd-d3eb-4c6d-81f8-e5d5958736c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:01:31.572069 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-16e225fd-d3eb-4c6d-81f8-e5d5958736c1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058470 Dec 15 16:01:31.572568 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Wed Dec 15 16:01:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:31.582951 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-fb8b1813-1587-40b9-8c53-85359d66c042 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:31.596000 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-fb8b1813-1587-40b9-8c53-85359d66c042 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017129 Dec 15 16:01:31.596515 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Wed Dec 15 16:01:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:01:31.606033 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-ddcfc86d-1a4b-463b-b214-b8daf47f5a80 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:31.619545 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-ddcfc86d-1a4b-463b-b214-b8daf47f5a80 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016782 Dec 15 16:01:31.620050 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Wed Dec 15 16:01:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:01:31.629820 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-b4256958-5a7d-4c37-ad81-ee73788a6e1f admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:31.634830 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.wsgi [None req-b4256958-5a7d-4c37-ad81-ee73788a6e1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:01:31.635385 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-b4256958-5a7d-4c37-ad81-ee73788a6e1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:01:31.636159 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-b4256958-5a7d-4c37-ad81-ee73788a6e1f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010267 Dec 15 16:01:31.636640 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Wed Dec 15 16:01:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:33.114296 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-ddcfc86d-1a4b-463b-b214-b8daf47f5a80 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:33.115284 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-ddcfc86d-1a4b-463b-b214-b8daf47f5a80 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Dec 15 16:01:33.115678 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:33.304179 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-b925e2cc-4164-4fb2-9a5f-53c0e4bf5279 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:33.309318 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.wsgi [None req-b925e2cc-4164-4fb2-9a5f-53c0e4bf5279 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:01:33.309875 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-b925e2cc-4164-4fb2-9a5f-53c0e4bf5279 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:01:33.310713 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-b925e2cc-4164-4fb2-9a5f-53c0e4bf5279 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056766 Dec 15 16:01:33.311209 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Wed Dec 15 16:01:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:33.320812 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-d9ea4509-0b33-43a9-b418-6760b82010bf admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:33.334485 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-d9ea4509-0b33-43a9-b418-6760b82010bf admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017121 Dec 15 16:01:33.334940 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Wed Dec 15 16:01:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:01:33.346632 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:33.359192 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018183 Dec 15 16:01:33.359705 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Wed Dec 15 16:01:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:01:33.369063 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-9fb3a99e-be6a-48c5-ae52-e1ee5662efb6 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:33.374053 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.wsgi [None req-9fb3a99e-be6a-48c5-ae52-e1ee5662efb6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:01:33.374642 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-9fb3a99e-be6a-48c5-ae52-e1ee5662efb6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:01:33.375418 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-9fb3a99e-be6a-48c5-ae52-e1ee5662efb6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009776 Dec 15 16:01:33.375932 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Wed Dec 15 16:01:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:34.837127 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:34.838134 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 15 16:01:34.838557 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:35.026203 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-5b8757b7-6e02-4a34-8baa-76c9f181751e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:35.046361 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-5b8757b7-6e02-4a34-8baa-76c9f181751e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070580 Dec 15 16:01:35.046978 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Wed Dec 15 16:01:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:01:36.526734 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:36.527763 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Dec 15 16:01:36.528156 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:36.716678 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-bb20e58e-e1ab-4ecd-bbc8-ea4922654c46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:36.733858 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-bb20e58e-e1ab-4ecd-bbc8-ea4922654c46 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067621 Dec 15 16:01:36.734424 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Wed Dec 15 16:01:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:01:38.228273 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:38.229301 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 15 16:01:38.229703 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:38.422915 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-466721de-cf5a-45a4-8d72-b32d8cdd6beb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:38.440613 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-466721de-cf5a-45a4-8d72-b32d8cdd6beb admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068516 Dec 15 16:01:38.441079 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Wed Dec 15 16:01:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:01:39.915522 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:39.916531 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 15 16:01:39.916927 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:40.105319 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-c998427f-19c6-443f-8d4b-dddde49bf044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:01:40.122131 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-c998427f-19c6-443f-8d4b-dddde49bf044 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067807 Dec 15 16:01:40.122617 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Wed Dec 15 16:01:40 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:01:41.608550 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:41.609575 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 15 16:01:41.610499 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:01:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:01:41.799249 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-73bc4a4d-236b-4b3d-81ff-cc5d61f1caec admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:01:41.817607 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-73bc4a4d-236b-4b3d-81ff-cc5d61f1caec admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069188 Dec 15 16:01:41.818086 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Wed Dec 15 16:01:41 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:02:29.035312 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:29.036305 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-21af7d7a-39a5-47ee-bdf5-b76857c4bebd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Dec 15 16:02:29.036705 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Wed Dec 15 16:02:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:02:29.092501 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-9701a4c1-2bbe-456e-8133-a391d00bb082 admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:29.111890 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-9701a4c1-2bbe-456e-8133-a391d00bb082 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068888 Dec 15 16:02:29.112406 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Wed Dec 15 16:02:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:02:29.133881 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-cdb8260e-e21c-46bf-acb8-488cf1d3233d admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:29.141362 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-cdb8260e-e21c-46bf-acb8-488cf1d3233d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010976 Dec 15 16:02:29.141869 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Wed Dec 15 16:02:29 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:02:29.153170 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-325db4d0-753b-4542-a2a2-fcaf5c2a542e admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:29.160925 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-325db4d0-753b-4542-a2a2-fcaf5c2a542e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011121 Dec 15 16:02:29.161419 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Wed Dec 15 16:02:29 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:02:29.173290 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-98f884d3-954b-4f59-89d2-c008af5a6425 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:29.180510 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-98f884d3-954b-4f59-89d2-c008af5a6425 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011355 Dec 15 16:02:29.181012 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Wed Dec 15 16:02:29 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:02:29.192173 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:02:29.199351 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010459 Dec 15 16:02:29.199846 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Wed Dec 15 16:02:29 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:03:57.630722 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-b2461467-8c46-427c-9b5e-06ecf081e64a tempest-verify_tempest_config-1617181701 tempest-verify_tempest_config-1617181701-project] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:03:57.632717 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-b2461467-8c46-427c-9b5e-06ecf081e64a tempest-verify_tempest_config-1617181701 tempest-verify_tempest_config-1617181701-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.110616 Dec 15 16:03:57.633246 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1133 bytes} [Wed Dec 15 16:03:57 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:05:23.650477 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:23.651482 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Dec 15 16:05:23.651878 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 36/70] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:05:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:05:23.920404 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-12ef65f7-aefe-45f3-98cb-d5c600351e19 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:23.921630 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:05:23.921630 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: warnings.warn(msg) Dec 15 16:05:23.923207 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-12ef65f7-aefe-45f3-98cb-d5c600351e19 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:23.923650 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-12ef65f7-aefe-45f3-98cb-d5c600351e19 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:23.924476 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-12ef65f7-aefe-45f3-98cb-d5c600351e19 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:23.924904 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-12ef65f7-aefe-45f3-98cb-d5c600351e19 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:23.957589 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-12ef65f7-aefe-45f3-98cb-d5c600351e19 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155491 Dec 15 16:05:23.958144 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 35/71] 10.222.0.41 () {60 vars in 1193 bytes} [Wed Dec 15 16:05:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:05:25.447286 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:25.448278 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 15 16:05:25.448701 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 37/72] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:05:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:05:25.639619 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-65b1903a-8baa-4648-9fdc-950c96096b89 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:25.641415 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:05:25.641415 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: warnings.warn(msg) Dec 15 16:05:25.642982 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-65b1903a-8baa-4648-9fdc-950c96096b89 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:25.643444 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-65b1903a-8baa-4648-9fdc-950c96096b89 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:25.644249 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-65b1903a-8baa-4648-9fdc-950c96096b89 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:25.644672 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-65b1903a-8baa-4648-9fdc-950c96096b89 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:25.663079 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-65b1903a-8baa-4648-9fdc-950c96096b89 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073488 Dec 15 16:05:25.663606 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 36/73] 10.222.0.41 () {60 vars in 1193 bytes} [Wed Dec 15 16:05:25 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:05:37.569990 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:37.571012 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 15 16:05:37.571405 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 38/74] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:05:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:05:37.761705 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-8a14abe5-51cd-4724-b2dd-d4224690e289 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:37.762876 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:05:37.762876 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: warnings.warn(msg) Dec 15 16:05:37.764395 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-8a14abe5-51cd-4724-b2dd-d4224690e289 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:37.764831 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-8a14abe5-51cd-4724-b2dd-d4224690e289 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:37.765621 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-8a14abe5-51cd-4724-b2dd-d4224690e289 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:37.766071 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-8a14abe5-51cd-4724-b2dd-d4224690e289 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:37.789792 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-8a14abe5-51cd-4724-b2dd-d4224690e289 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078501 Dec 15 16:05:37.790290 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 37/75] 10.222.0.41 () {60 vars in 1193 bytes} [Wed Dec 15 16:05:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:05:39.268182 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: DEBUG nova.api.openstack.wsgi [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] Calling method '>' {{(pid=101857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:39.269169 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: INFO nova.api.openstack.requestlog [None req-2d0de321-9699-45f0-a97b-e6113322c49d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Dec 15 16:05:39.269558 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: [pid: 101857|app: 0|req: 39/76] 10.222.0.41 () {56 vars in 1074 bytes} [Wed Dec 15 16:05:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:05:39.458493 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG nova.api.openstack.wsgi [None req-c47d14f4-83d5-42f2-9b43-61b3d7c63941 admin admin] Calling method '>' {{(pid=101856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:05:39.459913 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:05:39.459913 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: warnings.warn(msg) Dec 15 16:05:39.461431 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-c47d14f4-83d5-42f2-9b43-61b3d7c63941 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:39.461852 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-c47d14f4-83d5-42f2-9b43-61b3d7c63941 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:39.462662 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-c47d14f4-83d5-42f2-9b43-61b3d7c63941 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:05:39.463114 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: DEBUG oslo_concurrency.lockutils [None req-c47d14f4-83d5-42f2-9b43-61b3d7c63941 admin admin] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:05:39.483431 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: INFO nova.api.openstack.requestlog [None req-c47d14f4-83d5-42f2-9b43-61b3d7c63941 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075943 Dec 15 16:05:39.483905 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: [pid: 101856|app: 0|req: 38/77] 10.222.0.41 () {60 vars in 1193 bytes} [Wed Dec 15 16:05:39 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:06:36.543589 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: Wed Dec 15 16:06:36 2021 - graceful shutdown triggered... Dec 15 16:06:36.543717 dv-cinder-800703-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 16:06:36.544801 dv-cinder-800703-3-iscsi devstack@n-api.service[101856]: Gracefully killing worker 1 (pid: 101856)... Dec 15 16:06:36.546058 dv-cinder-800703-3-iscsi devstack@n-api.service[101857]: Gracefully killing worker 2 (pid: 101857)... Dec 15 16:06:37.544793 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: worker 1 buried after 1 seconds Dec 15 16:06:37.544793 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: worker 2 buried after 1 seconds Dec 15 16:06:37.544793 dv-cinder-800703-3-iscsi devstack@n-api.service[101855]: goodbye to uWSGI. Dec 15 16:06:37.546397 dv-cinder-800703-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 16:06:37.546986 dv-cinder-800703-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 16:06:37.550336 dv-cinder-800703-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:06:37.561154 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:06:37 2021] *** Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: nodename: dv-cinder-800703-3-iscsi Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: machine: x86_64 Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: clock source: unix Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: pcre jit disabled Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: detected number of CPU cores: 4 Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: current working directory: / Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: your processes number limit is 47680 Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: your memory page size is 4096 bytes Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: detected max file descriptor number: 2048 Dec 15 16:06:37.563858 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: lock engine: pthread robust mutexes Dec 15 16:06:37.564934 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: thunder lock: enabled Dec 15 16:06:37.564934 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:06:37.564934 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:06:37.608900 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: Python main interpreter initialized at 0x5608566879c0 Dec 15 16:06:37.608900 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: python threads support enabled Dec 15 16:06:37.608900 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: your server socket listen backlog is limited to 100 connections Dec 15 16:06:37.608900 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:06:37.609359 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:06:37.609359 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: *** Operational MODE: preforking *** Dec 15 16:06:37.609630 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:06:37.609630 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: spawned uWSGI master process (pid: 116058) Dec 15 16:06:37.609831 dv-cinder-800703-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:06:37.610457 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: spawned uWSGI worker 1 (pid: 116080, cores: 1) Dec 15 16:06:37.610979 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: spawned uWSGI worker 2 (pid: 116081, cores: 1) Dec 15 16:06:37.611280 dv-cinder-800703-3-iscsi devstack@n-api.service[116058]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:06:39.485941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:39.485941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: from cryptography.utils import int_from_bytes Dec 15 16:06:39.486659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:39.486659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: from cryptography.utils import int_from_bytes Dec 15 16:06:39.487025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:39.487025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: from cryptography.utils import int_from_bytes Dec 15 16:06:39.487566 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:06:39.487566 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: from cryptography.utils import int_from_bytes Dec 15 16:06:41.873328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:06:41.873831 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:06:41.874091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:06:41.874497 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:06:41.874758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:06:41.875167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.875495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.875820 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.876147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.876485 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.876801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.877128 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.878095 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.878351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.878620 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.878943 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.879273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-3-iscsi {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.879601 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.879913 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.880230 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.880555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.880865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.881199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.881511 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.882016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.883148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.883148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.883334 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:06:41.883715 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.883797 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:06:41.883877 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.883954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:06:41.884025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.884025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.884172 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:06:41.884282 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:06:41.884440 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.884646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.884756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.884964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.885070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.885281 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.885395 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.885598 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.885689 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-3-iscsi {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.885931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.886025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.886270 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.886387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.886592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.886686 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.886913 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887069 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887512 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887829 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.887993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.888157 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800703-3-iscsi {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.888333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.888481 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.888646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.888786 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.888980 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.889111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.889306 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.889433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.889633 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.889746 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.889961 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.890061 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.890288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.890442 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.890602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.890917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891032 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891249 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891860 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.891959 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.892116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.892223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.892429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.892530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.892755 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.892858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.893628 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.893727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.893939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894344 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894815 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.894980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800703-3-iscsi {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.895142 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.895256 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.895458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.895560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.895774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.895874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.896087 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.896270 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.896428 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.896584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.896726 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.896896 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897326 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897863 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.897969 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.898210 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.898321 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.898535 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.898628 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.898846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.898943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.899169 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.899266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.899473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.899573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.899780 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.899880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.900092 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.900183 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.900410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.900508 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.900715 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.900808 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901021 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901113 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901275 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901703 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.901911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902580 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902689 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.902932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.903099 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.903267 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.903416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.903567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.903728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.903828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904013 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904436 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.904941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905251 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905353 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905662 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.905979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.906193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.906304 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.906510 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.906622 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.906828 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.906927 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.907142 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.907398 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.907511 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.907714 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.907825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.908035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.908136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.908343 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.908480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.908680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.908780 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909429 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.909960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.910067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.910351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.910451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.910624 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.910750 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.910931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911348 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911469 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911557 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911647 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911852 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.911955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.912167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.912432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.912523 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.912620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.912712 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.912796 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913004 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913096 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.913936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914027 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914389 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914566 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914660 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.914973 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.915181 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.915287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.915491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.915591 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.915800 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.915902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.916108 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.916208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.916417 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.916515 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.916722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.916819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917117 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917327 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917630 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.917948 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.918042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.918285 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.918394 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.918592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.918697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.919157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.919270 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.919462 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.919561 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.919770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.919871 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.920091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.920183 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.920399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.920491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.920704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.920801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.921027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.921127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.921335 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.921442 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.921644 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.921747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.921960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.922054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.922295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.922401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.922605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.922696 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.922923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.923027 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.923223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.923365 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.923533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.923667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.923852 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.924002 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.924183 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.924315 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.924491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.924631 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.924797 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.924907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.925103 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.925202 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.925408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.925499 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.925715 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.925823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.926018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.926109 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.926334 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.926429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.926636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.926732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.926955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.927047 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.927275 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.927364 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.927586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.927729 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.927897 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.928021 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.928204 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.928298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.928523 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:06:41.928625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.928865 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.928966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.929274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.929393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.929538 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.929646 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.929852 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.929943 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.930204 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.930300 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.930527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.930636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.930847 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.930945 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.931161 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.931262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.931477 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.931587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.931805 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.931916 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.932113 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.932212 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.932424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.932521 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.932731 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.932822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933048 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933139 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933355 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933679 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933771 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.933994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.934090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.934338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.934474 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.934664 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.934765 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.934975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.935066 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.935292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.935384 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.935607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.935706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.935920 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.936028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.936229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.936320 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.936567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.936719 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.936880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.937019 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.937198 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.937324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.937512 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.937639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938282 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938433 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938786 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.938895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.939120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.939230 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.939368 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.939562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.939678 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.940313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.940432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.940555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.940681 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.940799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.940916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.941121 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.941254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942198 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942853 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.942924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943085 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943385 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.943889 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.944009 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.944229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.944396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.944570 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.944857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945340 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945635 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.945936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946315 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946406 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946664 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.946980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947285 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947386 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947899 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.947999 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.948205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.948305 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.948521 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.948620 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.948836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.948928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.949150 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.949249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.949471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.949584 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.949800 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.949921 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.950113 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.950239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.950451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.950543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.950774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.950879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.951096 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.951196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.951401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.951498 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.951728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.951879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952048 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952189 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952667 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.952980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953285 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953384 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953694 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953894 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.953986 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.954244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.954395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.954555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.954657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.954862 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.954967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.955168 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.955303 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.956081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.956225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.956391 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.956648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.956789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.956911 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957307 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.957917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.958010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.958283 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.958391 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.958593 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.958699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.958936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.959035 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.959247 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.959337 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.959578 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.959681 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.959899 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960004 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960209 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960300 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960838 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.960928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.961145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.961235 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.961456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.961560 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.961768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.961865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.962089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.962239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.962439 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.962553 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.962756 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.962854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.963100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.963198 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.963382 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.963482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.963692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.963788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964007 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964721 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.964935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965150 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965656 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965871 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.965964 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.966237 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.966335 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.966520 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.966621 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.966832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.966937 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.967142 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.967288 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.967451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.967592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.967762 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.967917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.968594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.968689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.968689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.968857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.968949 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969098 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969368 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969494 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969594 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969682 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.969924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.970631 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.970707 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.970776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.970860 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.970933 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971163 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971312 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971503 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971585 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971794 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.971887 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.972115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.972205 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.972429 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.972518 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.972741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.972824 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973054 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973361 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973668 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973802 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.973982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.974071 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.974888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.975049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.975207 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.975399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.975557 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.975709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.975861 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976306 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976677 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976759 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.976969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977056 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977229 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977587 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.977910 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.978004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.978330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.978515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.978818 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.978919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.979144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.979258 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.979464 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.979583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.979772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.979907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.980077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.980234 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.980386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.980558 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.980732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.980894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.981047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.981253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.981346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.981564 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.981695 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.981910 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982231 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982330 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982667 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982877 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.982977 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.983195 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.983306 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.983513 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.983610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.983823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.983919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.984131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.984236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.984440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.984544 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.984745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.984849 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.985055 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.985239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.985371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.985498 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.985732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986503 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986822 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.986947 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.987109 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.987265 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.987355 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.987592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.987697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.987937 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.988170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.988274 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.988609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.988805 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.988907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989000 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989085 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989402 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989598 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.989936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.990038 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.990334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.990433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.990641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.990769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.990939 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991375 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991569 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991875 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.991966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.992179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.992279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.992480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.992570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.992785 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.992875 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.993088 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.993193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.993402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.993500 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.993704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.993802 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.994010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.994111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.994372 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.994480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.994829 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.994930 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995269 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995684 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995891 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.995990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.996196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.996294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.996507 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.996609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.996808 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.996898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.997111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.997204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.997415 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.997507 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.997733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.997825 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.998065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.998197 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.998388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.998493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.998700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.998792 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999423 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:41.999944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000367 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000562 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000866 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.000959 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.001175 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.001273 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.001480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.001571 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.001785 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.001878 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.002093 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.002715 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.002940 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003348 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.003967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.004178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.004276 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.004482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.004579 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.004837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.004948 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005183 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005391 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005695 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005796 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.005995 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.006094 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.006326 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.006421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.006633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.006739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.006942 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007041 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007243 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007335 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007559 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007866 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.007966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.008170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.008268 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.008472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.008645 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.008775 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.008915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.009084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.009177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.009394 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.009531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.009718 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.009810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010361 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010462 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010771 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.010978 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011198 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.011975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.012225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.012557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.012874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.012961 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.013184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.013280 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.013492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.013573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.013818 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.013900 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.014134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.014257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.014468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.014557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.014776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.015027 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.015113 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.015194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.015376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.015466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.016608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.016724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.016808 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.016890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.016969 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017046 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017301 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017467 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017644 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.017845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.018605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.018725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.018936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.019032 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.019288 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.019403 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.019604 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.019714 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.019929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020659 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.020966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.021187 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.021286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.021499 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.021590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.021811 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.021909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.022114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.022237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.022455 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.022558 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.022767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.022867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.023080 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.023204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.023384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.023522 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.023688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.023839 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024322 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024468 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024787 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.024955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.025156 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.025281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.025405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.025607 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.025721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.025911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.026117 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.026258 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.026481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.026588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.026786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.026899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.027102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.027194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.027413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.027513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.027724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.027817 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028350 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028441 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.028965 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029056 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.029993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.030233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.030411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.030563 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.030663 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.030874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.030972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.031182 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.031286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.031495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.031700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.031793 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032338 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032666 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.032996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.033124 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.033327 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.033425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.033731 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.033823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.034054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.034167 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.034400 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.034491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.034717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.034807 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035033 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035132 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035445 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035826 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.035970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.036062 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.036299 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.036400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.036713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.036828 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.036950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037350 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037892 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.037994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.038219 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.038316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.038530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.038643 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.038835 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.038975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.039162 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.039288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.039476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.039601 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.039801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.039917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.040229 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.040540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.040630 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.040870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.040995 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.041182 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.041280 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.041547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.041639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.041833 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.041917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.042149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.042256 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.043230 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.043346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.043504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.043595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.043675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.043753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044241 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.044933 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045243 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045564 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.045959 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050392 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050497 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050722 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.050946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051122 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051500 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.051946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052022 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052190 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052263 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052488 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052721 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052883 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.052955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053112 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053635 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053703 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.053928 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054007 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054086 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054303 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054763 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.054982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.055078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.055301 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.055404 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.055610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.055704 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.055914 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056219 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056669 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056876 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.056978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.057199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.057301 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.057535 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.057632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.057868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.057972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.058203 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.058308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.058569 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.058665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.058857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.058960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.059175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.059316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.059500 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.059600 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.059819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.059925 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.060128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.060222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.060438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.060530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.060755 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.060853 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.061114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.061212 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.061480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.061578 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.061661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.061990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.062080 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.062424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.062514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.062588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.062673 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063082 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063261 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063762 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.063933 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.064003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.064080 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.064159 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065804 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.065962 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.066034 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.066104 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.066196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.066426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.066546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067329 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067432 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067535 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067619 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067785 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067866 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.067937 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.068015 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.068086 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069227 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069385 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069696 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.069946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.070026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.070110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.070341 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.070446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.071547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.071645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.071718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.071799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.071872 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.071942 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.072956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073177 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073607 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.073888 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.074067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.074180 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.074376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.074471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.074659 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.074912 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.075049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.075233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.075349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.075589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.075675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.075926 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.076031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.076209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.076343 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.076523 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.076633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.076910 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077013 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077197 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077778 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.077873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.078054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.078173 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.078409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.078497 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.078762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.078858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.079043 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.079302 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.079411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.079625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.079724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.079947 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.080053 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.080255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.080410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.081185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.081363 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.081525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.081691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.081800 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.082017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.082131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.082422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.082524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.082709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.082818 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083458 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083790 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.083996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.084103 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.084310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.084417 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.084633 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.084732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.084951 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.085156 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.085255 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.085608 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.085723 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.085808 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.085890 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.086144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.086274 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.086481 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.086591 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.086890 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087154 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087326 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087415 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087794 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.087897 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.088087 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.088189 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.088505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.088607 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.088682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.088761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089191 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089526 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089679 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.089840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.090196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.090196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.090557 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.090711 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.090864 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.091016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.091186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.091450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.091618 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.091784 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.091938 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092092 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.092997 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.093164 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.093318 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.093318 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.093616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.093616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.093928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.094091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.094269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.094433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.094586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.094738 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.094890 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.095054 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.095209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.095361 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.095520 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.095828 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096659 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096818 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.096980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.097224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.097383 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.097545 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.097706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.097869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.098118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.098318 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.098626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.098798 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.098960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.099128 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.099291 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.099451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.099617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.099779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.099931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.100096 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.100250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.100434 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.100588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.100739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.100899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.101061 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.101230 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.101387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.101653 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.101815 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.101967 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.102134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.102322 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.102477 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.102640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.102640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.102944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.103100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.103251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.103403 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.103555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.103706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.103866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104190 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104343 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104515 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104668 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104830 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.104991 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.105145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.105305 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.105459 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.105619 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.106008 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.106234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.106395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.106547 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.106701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.106701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.107027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.107181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.107426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.107426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.107739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.107907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.108068 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.108221 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.108374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.108536 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.108828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109169 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109321 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109813 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.109970 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.110129 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.110304 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.110468 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.110621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.110788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.110943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.111120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.111291 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.111445 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.111647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.111905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.112065 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.112219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.112379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.112532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.112699 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.112861 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.113022 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.113194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.113356 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.113508 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.113669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.113867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.114039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.114233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.114401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.114562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.114726 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.114880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.115041 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.115195 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.115368 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.115532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.115699 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.115853 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.116162 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.116321 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.116482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.116648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.116802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.116955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.117117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.117270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.117454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.117691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.117850 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.118001 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.118183 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.118343 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.118506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.118675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.118966 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.119126 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.119295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.119459 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.119622 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.119789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.119942 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.120096 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.120249 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.120409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.120572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.120727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.120879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.121042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.121196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.121367 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.121531 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.121695 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.121848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.122122 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.122329 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.122497 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.122651 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.122804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.122964 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.123125 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.123279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.123452 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.123613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.123784 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.123946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.124100 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.124261 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.124429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.124584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.124737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.124898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.125059 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.125222 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.125384 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.125547 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.125710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.125880 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.126041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.126374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.126545 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.126707 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.126867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.127029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.127182 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.127871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.127871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.128263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.128418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.128579 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.128756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129226 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.129679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.130884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132897 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.132897 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.133191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.133360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.133621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.133935 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.134426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:06:42.134598 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:06:42.149667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_db.sqlalchemy.engines [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.157853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_db.sqlalchemy.engines [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.225339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.context [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cda00ea0-fd54-437b-b7c8-456fcc486c03(cell1) {{(pid=116081) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:06:42.227642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.context [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cda00ea0-fd54-437b-b7c8-456fcc486c03(cell1) {{(pid=116080) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:06:42.229641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:06:42.231270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:06:42.231860 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:06:42.232099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:06:42.233438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:06:42.234063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:06:42.234312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:06:42.236203 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:06:42.247905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_db.sqlalchemy.engines [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.249207 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_db.sqlalchemy.engines [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.250641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_db.sqlalchemy.engines [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.253551 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_db.sqlalchemy.engines [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.417921 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_db.sqlalchemy.engines [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.421107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_db.sqlalchemy.engines [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:06:42.743590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: WARNING keystonemiddleware.auth_token [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:06:42.744545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: WARNING keystonemiddleware.auth_token [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:06:42.750101 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: WARNING keystonemiddleware.auth_token [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:06:42.751260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: WARNING keystonemiddleware.auth_token [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:06:43.092425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: WARNING keystonemiddleware.auth_token [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:06:43.097829 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: WARNING keystonemiddleware.auth_token [None req-38de996a-2fdf-439e-8c50-c64eb4447937 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:06:43.100315 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: WARNING keystonemiddleware.auth_token [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:06:43.103082 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608566879c0 pid: 116081 (default app) Dec 15 16:06:43.105544 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: WARNING keystonemiddleware.auth_token [None req-0176b47d-ec52-42a6-a302-6675d599c575 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:06:43.110919 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608566879c0 pid: 116080 (default app) Dec 15 16:07:15.538178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-79478427-1371-4ce4-873d-69b3ff2e447a tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Action: 'create', calling method: .version_select at 0x7f051621ae50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-418649385", "metadata": {"Type": "work"}}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:15.539836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-79478427-1371-4ce4-873d-69b3ff2e447a tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:07:15.540747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-79478427-1371-4ce4-873d-69b3ff2e447a tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.939065 Dec 15 16:07:15.541286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Wed Dec 15 16:07:14 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 941 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:07:15.770850 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d506bcf2-f40a-4f33-8fc1-9b340debd7c5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Action: 'create', calling method: .version_select at 0x7f0516266a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1805686962", "metadata": {"Type": "work"}}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:15.771405 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d506bcf2-f40a-4f33-8fc1-9b340debd7c5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:07:15.771889 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d506bcf2-f40a-4f33-8fc1-9b340debd7c5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.224009 Dec 15 16:07:15.772667 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 1/2] 10.222.0.41 () {60 vars in 1155 bytes} [Wed Dec 15 16:07:15 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:07:15.781398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-03575de5-e1da-40fd-8696-19386e800cad tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Action: 'create', calling method: .version_select at 0x7f05162389d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-366447768", "metadata": {"Type": "work"}}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:15.783183 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-03575de5-e1da-40fd-8696-19386e800cad tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:07:15.784498 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-03575de5-e1da-40fd-8696-19386e800cad tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006775 Dec 15 16:07:15.785110 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 2/3] 10.222.0.41 () {60 vars in 1155 bytes} [Wed Dec 15 16:07:15 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:07:15.793928 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-af16ff9d-275d-40b8-91b8-a477262054a9 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Calling method '.version_select at 0x7f051627e5e0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:17.401908 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-af16ff9d-275d-40b8-91b8-a477262054a9 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] HTTP exception thrown: Volume tempest-invalid-937531938 could not be found. Dec 15 16:07:17.403424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-af16ff9d-275d-40b8-91b8-a477262054a9 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Returning 404 to user: Volume tempest-invalid-937531938 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:07:17.404542 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-af16ff9d-275d-40b8-91b8-a477262054a9 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-937531938" status: 404 len: 98 microversion: 2.1 time: 1.614438 Dec 15 16:07:17.405289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1214 bytes} [Wed Dec 15 16:07:15 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-937531938 => generated 98 bytes in 1616 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 15 16:07:17.415609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a35ccd5f-4990-4e90-a1f4-9d80aff749a5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003889 Dec 15 16:07:17.416425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 3/5] 10.222.0.41 () {58 vars in 1139 bytes} [Wed Dec 15 16:07:17 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:07:17.425675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c9ce893b-ffc4-49f5-9fb2-7f42e7e1b246 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003895 Dec 15 16:07:17.426927 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 3/6] 10.222.0.41 () {58 vars in 1136 bytes} [Wed Dec 15 16:07:17 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:07:17.435673 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4892ea69-1be9-458c-a1b8-600e12a2942d tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Calling method '.version_select at 0x7f051621af70>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:18.244059 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-4892ea69-1be9-458c-a1b8-600e12a2942d tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] HTTP exception thrown: Volume 71dcd949-b7d8-481d-b96a-1d143f5c05f6 could not be found. Dec 15 16:07:18.244965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4892ea69-1be9-458c-a1b8-600e12a2942d tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Returning 404 to user: Volume 71dcd949-b7d8-481d-b96a-1d143f5c05f6 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:07:18.245874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4892ea69-1be9-458c-a1b8-600e12a2942d tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/71dcd949-b7d8-481d-b96a-1d143f5c05f6" status: 404 len: 109 microversion: 2.1 time: 0.813734 Dec 15 16:07:18.254325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1247 bytes} [Wed Dec 15 16:07:17 2021] DELETE /compute/v2.1/os-volumes/71dcd949-b7d8-481d-b96a-1d143f5c05f6 => generated 109 bytes in 823 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:18.257898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8a5ac85d-ed5f-416b-a337-10e7490460d5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Calling method '.version_select at 0x7f0516137f70>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:18.294573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-8a5ac85d-ed5f-416b-a337-10e7490460d5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] HTTP exception thrown: Volume 9b630602-d614-4a43-a6a5-c46cdce6530b could not be found. Dec 15 16:07:18.295171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8a5ac85d-ed5f-416b-a337-10e7490460d5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] Returning 404 to user: Volume 9b630602-d614-4a43-a6a5-c46cdce6530b could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:07:18.296156 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8a5ac85d-ed5f-416b-a337-10e7490460d5 tempest-VolumesNegativeTest-2069939160 tempest-VolumesNegativeTest-2069939160-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/9b630602-d614-4a43-a6a5-c46cdce6530b" status: 404 len: 109 microversion: 2.1 time: 0.043571 Dec 15 16:07:18.296703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:07:18 2021] GET /compute/v2.1/os-volumes/9b630602-d614-4a43-a6a5-c46cdce6530b => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:07:19.975225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1164145593", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "759c34f4-14be-417a-897c-06d30e0fd249"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:20.185377 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] validate_networks() for [('759c34f4-14be-417a-897c-06d30e0fd249', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:07:22.456825 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-94043339", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "5867fdd0-c07f-4aea-8201-7f39fd75db79"}]}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:22.634895 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] validate_networks() for [('5867fdd0-c07f-4aea-8201-7f39fd75db79', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:07:23.342995 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:07:23.344055 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:07:23.345294 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:07:23.345895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:07:23.346554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:07:23.371737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:23.373404 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:23.375798 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:23.376526 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:23.450303 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:23.462322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for user 50f2f5e4390046308cce9ef7ab394abd and project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:23.495249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:07:23.500291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:07:23.704542 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-46deaba8-5646-4598-989e-f5edf77d839d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.984166 Dec 15 16:07:23.705254 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 5/9] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:07:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 3986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:07:23.716595 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1cf5d63c-afa4-4830-87ad-0fe013e2d56d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:23.717388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1cf5d63c-afa4-4830-87ad-0fe013e2d56d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:23.993571 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1cf5d63c-afa4-4830-87ad-0fe013e2d56d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:24.032979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1cf5d63c-afa4-4830-87ad-0fe013e2d56d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1218 microversion: 2.1 time: 0.320368 Dec 15 16:07:24.034388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 6/10] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:23 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1218 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:24.695939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:07:24.697090 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:07:24.697833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:07:24.698517 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:07:24.699154 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:07:24.729471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:24.729931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:24.734422 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:24.734956 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:24.776923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Getting quotas for project fc182f1b5d374414ba1fa8c369cf6372. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:24.783956 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Getting quotas for user a7767b34fd0a49adbbfaf004bbb64a32 and project fc182f1b5d374414ba1fa8c369cf6372. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:24.812688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:07:24.817247 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:07:25.041425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e0c474de-24b1-4903-a2ac-be7956ab092f tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.048208 Dec 15 16:07:25.047519 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 5/11] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:07:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:07:25.053480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6320d67d-7fe3-46df-a039-f0c7ff0aab3b tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:25.054091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6320d67d-7fe3-46df-a039-f0c7ff0aab3b tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:25.078575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4664d09d-11bd-4550-9252-e3ba879b4d69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:25.079400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4664d09d-11bd-4550-9252-e3ba879b4d69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:25.466749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4664d09d-11bd-4550-9252-e3ba879b4d69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:25.507841 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4664d09d-11bd-4550-9252-e3ba879b4d69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1218 microversion: 2.1 time: 0.456958 Dec 15 16:07:25.509761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 6/12] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:25 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1218 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:25.668743 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6320d67d-7fe3-46df-a039-f0c7ff0aab3b tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:25.691732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6320d67d-7fe3-46df-a039-f0c7ff0aab3b tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1213 microversion: 2.1 time: 0.641803 Dec 15 16:07:25.696716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:25 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1213 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:26.525779 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:26.527318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:26.539773 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:26.551184 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:26.552198 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:26.552795 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:26.715607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8af9a217-d462-47cd-9f93-5f136afd1168 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:26.716977 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8af9a217-d462-47cd-9f93-5f136afd1168 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:26.979693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8af9a217-d462-47cd-9f93-5f136afd1168 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:26.988212 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8af9a217-d462-47cd-9f93-5f136afd1168 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1213 microversion: 2.1 time: 0.279497 Dec 15 16:07:26.997533 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 8/14] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:26 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:27.129502 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:27.154560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-afe21e4e-ca1e-43da-ab0d-17e59986ad85 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1214 microversion: 2.1 time: 0.633505 Dec 15 16:07:27.157400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 7/15] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:26 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1214 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:28.007818 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:28.009190 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:28.017532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:28.018393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:28.019492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:28.020147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:28.173748 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:28.174674 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:28.187954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:28.191700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:28.193106 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:28.196169 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:28.521401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:28.542278 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-22e4e8a4-a8be-456c-8104-dd41f2322adb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1276 microversion: 2.1 time: 0.372843 Dec 15 16:07:28.556763 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:28 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:29.035744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:29.100661 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-85674bb7-7b65-442f-adf1-1e2879435ab0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1273 microversion: 2.1 time: 1.098105 Dec 15 16:07:29.101273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 9/17] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:28 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1273 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:29.178571 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-76e0c9ae-3891-4cbf-803d-321484d171ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: .version_select at 0x7f0514eee940>, body: {"keypair": {"name": "tempest-keypair-1010631025"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:29.264183 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-76e0c9ae-3891-4cbf-803d-321484d171ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:29.299344 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-76e0c9ae-3891-4cbf-803d-321484d171ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for user 14a01a159df049e58616233166b0a007 and project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:29.562186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:29.563116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:29.577887 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:29.581453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:29.582894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:29.584802 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:30.025929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-76e0c9ae-3891-4cbf-803d-321484d171ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:30.031752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-76e0c9ae-3891-4cbf-803d-321484d171ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for user 14a01a159df049e58616233166b0a007 and project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:30.050545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-76e0c9ae-3891-4cbf-803d-321484d171ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.160424 Dec 15 16:07:30.051767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 9/18] 10.222.0.41 () {60 vars in 1157 bytes} [Wed Dec 15 16:07:28 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:30.121032 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:30.122106 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:30.134143 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:30.134630 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:30.137952 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:30.140945 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:30.358949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:30.380870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-86206d8c-34ed-4b38-bef2-92534798256f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1276 microversion: 2.1 time: 0.823726 Dec 15 16:07:30.385053 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 10/19] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:29 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1276 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:30.441345 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:30.468640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8f910fbc-ad06-41e9-95a6-af3ecabfcf1a tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1271 microversion: 2.1 time: 0.351601 Dec 15 16:07:30.473089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 10/20] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:30 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:31.403037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:31.403659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:31.421222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:31.423859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:31.430328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:31.431420 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:31.492180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:31.493193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:31.510603 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:31.513632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:31.515873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:31.518463 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:31.694037 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:31.708477 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2ebe4702-9a5a-4509-8a63-ac06d4234ec5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1271 microversion: 2.1 time: 0.215825 Dec 15 16:07:31.709756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 11/21] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:31 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:32.401587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:32.413794 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5e33c89e-c22b-4730-b82d-242137e6a861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1276 microversion: 2.1 time: 1.017801 Dec 15 16:07:32.416704 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:31 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1276 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:32.727992 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:32.728991 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:32.763916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:32.765505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:32.768532 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:32.772883 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:33.435010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:33.436625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:33.448772 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:33.452692 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:33.453811 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:33.455561 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:34.021954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:34.036159 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-900e119a-0cc3-4d97-b4d4-ca53b307c728 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 1.313757 Dec 15 16:07:34.054631 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 12/23] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:32 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:34.981425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:34.992949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-73112478-8d8c-4cbf-9dee-d56b9ffbcdc8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 1.564880 Dec 15 16:07:34.996160 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 12/24] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:33 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:35.071763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:35.072480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:35.088420 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:35.092421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:35.108282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:35.109179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:35.180274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-75e80c2b-a682-470e-a6f4-904b99639c6e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'create', calling method: .version_select at 0x7f0514ebe700>, body: {"keypair": {"name": "tempest-keypair-626206936"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:35.268053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-75e80c2b-a682-470e-a6f4-904b99639c6e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:35.301877 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-75e80c2b-a682-470e-a6f4-904b99639c6e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for user e70e00befa3d41d0b5949f99d36c9b14 and project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:35.512637 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-75e80c2b-a682-470e-a6f4-904b99639c6e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:35.536488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-75e80c2b-a682-470e-a6f4-904b99639c6e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for user e70e00befa3d41d0b5949f99d36c9b14 and project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:35.603991 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-75e80c2b-a682-470e-a6f4-904b99639c6e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.974273 Dec 15 16:07:35.612325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 13/25] 10.222.0.41 () {62 vars in 1198 bytes} [Wed Dec 15 16:07:34 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 983 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 15 16:07:36.010947 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:36.012020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:36.025202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:36.028799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:36.031116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:36.035170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:36.832312 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:36.847396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-58688bf7-de9f-4e07-8e43-c4bc5ce43fff tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 1.779264 Dec 15 16:07:36.848019 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 13/26] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:35 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:37.865905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:37.867307 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:37.879850 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:37.882370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:37.891849 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:37.892645 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:38.412495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:38.424460 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6a2e8acf-1e96-4a3f-aa25-5f15c2b40861 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 2.417352 Dec 15 16:07:38.432692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 14/27] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:36 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:38.591115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-f93e7773-1870-4269-88dc-0de113ea6dbd req-a6d6a34c-0b53-48d7-bef5-21e3ddf00eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771cf51f-79f3-4a84-8ebc-a9497a016143", "tag": "fbcf44b9-d476-4aba-a276-c67d0625074b"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:38.594545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:38.594545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:07:38.683884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f93e7773-1870-4269-88dc-0de113ea6dbd req-a6d6a34c-0b53-48d7-bef5-21e3ddf00eb3 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:38.685892 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f93e7773-1870-4269-88dc-0de113ea6dbd req-a6d6a34c-0b53-48d7-bef5-21e3ddf00eb3 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:38.722625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-f93e7773-1870-4269-88dc-0de113ea6dbd req-a6d6a34c-0b53-48d7-bef5-21e3ddf00eb3 service nova] Creating event network-changed:fbcf44b9-d476-4aba-a276-c67d0625074b for instance 771cf51f-79f3-4a84-8ebc-a9497a016143 on hv-cinder-80070 Dec 15 16:07:38.727977 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f93e7773-1870-4269-88dc-0de113ea6dbd req-a6d6a34c-0b53-48d7-bef5-21e3ddf00eb3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:07:38.729811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:38.730472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:38.731913 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:38.732523 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:38.745276 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.compute.rpcapi [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:07:38.754511 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] Releasing lock "compute-rpcapi-router" {{(pid=116080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:07:38.823754 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b0b7d52c-29b9-404a-8174-fcc226910e78 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.387956 Dec 15 16:07:38.824629 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:07:38.860789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:38.870376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b9e08356-15c8-4f8c-a464-c983af964215 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 1.008660 Dec 15 16:07:38.887393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 14/29] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:37 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:39.450984 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:39.455694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:39.474784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:39.475239 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:39.485784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:39.489926 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:40.195236 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1002064483", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d84380ad-1686-4ecc-ba8f-571feeb05d97"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:40.351225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] validate_networks() for [('d84380ad-1686-4ecc-ba8f-571feeb05d97', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:07:40.496468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:40.506558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-095aecf0-428d-49a5-a2e7-a969a3af5b8f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 1.060516 Dec 15 16:07:40.514504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 16/30] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:39 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:40.529148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:40.533585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:40.569930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:40.571593 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:40.573337 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:40.576372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:41.203487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:41.213422 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e401988b-be54-4b32-8c28-7a27e998e456 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.697774 Dec 15 16:07:41.214332 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 17/31] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:40 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:41.227445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-f086a8e6-21ef-45aa-b5a1-f5d8aa89a4e1 req-cb139454-3d3e-4a19-baa9-e3bf87b4af96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132a29-e694-4b33-b9c1-3be0e2555008", "tag": "eb06d20a-14b8-4cc1-8d1b-28c1855f50ed"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:41.229266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:41.229266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:07:41.242242 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f086a8e6-21ef-45aa-b5a1-f5d8aa89a4e1 req-cb139454-3d3e-4a19-baa9-e3bf87b4af96 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:41.244314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f086a8e6-21ef-45aa-b5a1-f5d8aa89a4e1 req-cb139454-3d3e-4a19-baa9-e3bf87b4af96 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:41.275916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-f086a8e6-21ef-45aa-b5a1-f5d8aa89a4e1 req-cb139454-3d3e-4a19-baa9-e3bf87b4af96 service nova] Creating event network-changed:eb06d20a-14b8-4cc1-8d1b-28c1855f50ed for instance 90132a29-e694-4b33-b9c1-3be0e2555008 on hv-cinder-80070 Dec 15 16:07:41.292030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-f086a8e6-21ef-45aa-b5a1-f5d8aa89a4e1 req-cb139454-3d3e-4a19-baa9-e3bf87b4af96 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076461 Dec 15 16:07:41.302255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 18/32] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:07:41.533472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:41.535624 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:41.558418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:41.558919 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:41.568313 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:41.568810 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:41.906020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:07:41.907309 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:07:41.908108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:07:41.908625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:41.908827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:07:41.909371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:07:41.946588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9b2d4264-845b-4280-8c38-20cfa5f7d35e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.418908 Dec 15 16:07:41.948159 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 19/33] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:41 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:41.968449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:41.969800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:41.972231 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-268497760", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "712a2ed7-316f-482c-893d-a6ba2836f0df"}], "security_groups": [{"name": "tempest-securitygroup--542986755"}], "key_name": "tempest-keypair-1010631025", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:41.972477 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:41.976036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:42.036939 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Getting quotas for project 365cc23ac7624aab91c3f286c2a4db76. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:42.051728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Getting quotas for user b884220871ec4a30b495f27c8c8b325b and project 365cc23ac7624aab91c3f286c2a4db76. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:42.082031 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:07:42.084316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:07:42.141568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b473b9b5-384b-45ba-b7e4-12f5e7de3b5a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.421359 Dec 15 16:07:42.148164 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 15/34] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:07:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:07:42.153846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6cd3318e-500e-4187-8761-addc8279051e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:42.154738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6cd3318e-500e-4187-8761-addc8279051e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:42.164873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] validate_networks() for [('712a2ed7-316f-482c-893d-a6ba2836f0df', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:07:42.354464 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6cd3318e-500e-4187-8761-addc8279051e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:42.367379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6cd3318e-500e-4187-8761-addc8279051e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1222 microversion: 2.1 time: 0.217556 Dec 15 16:07:42.379892 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 16/35] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:42 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:42.394360 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:42.395201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:42.402975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:42.404068 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:42.405042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:42.406026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:42.855524 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:42.873191 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9982a9c4-27d0-4dc0-8a25-e2c075e47834 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.492054 Dec 15 16:07:42.883223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 17/36] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:42 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:42.891081 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-392627579", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d84380ad-1686-4ecc-ba8f-571feeb05d97"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:42.956971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] validate_networks() for [('d84380ad-1686-4ecc-ba8f-571feeb05d97', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:07:43.392461 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:07:43.393524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:07:43.394146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:07:43.394791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:07:43.395360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:07:43.413534 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:43.414423 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:43.418454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:43.422733 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:43.464319 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:43.464615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:07:43.465047 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:07:43.465524 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:07:43.466102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:07:43.466891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:07:43.481676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:43.482629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:43.483710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:43.485795 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:43.527223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for user 14a01a159df049e58616233166b0a007 and project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:43.535642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Getting quotas for project 365cc23ac7624aab91c3f286c2a4db76. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:43.564974 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Getting quotas for user b884220871ec4a30b495f27c8c8b325b and project 365cc23ac7624aab91c3f286c2a4db76. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:43.614597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:07:43.622651 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:07:43.626534 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:07:43.634267 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:07:43.775237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9496ac0e-cf74-44f8-ac47-e98554c7fca2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.890296 Dec 15 16:07:43.775883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:07:42 2021] POST /compute/v2.1/servers => generated 383 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:07:43.779107 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-64346c1f-5fa4-4a44-b1ed-431454335db7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.823745 Dec 15 16:07:43.784333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 20/38] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:07:41 2021] POST /compute/v2.1/servers => generated 401 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:07:43.795096 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:43.795725 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:43.802670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-920556634", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9de569e-dedf-412f-ac55-6fe163ed494a"}], "security_groups": [{"name": "tempest-securitygroup--270781960"}], "key_name": "tempest-keypair-626206936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:43.816939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:43.817534 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:43.821995 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:43.822662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:44.247275 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:44.256910 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-53299566-d9af-4cb8-9d1b-fbd06955e0ad tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.471248 Dec 15 16:07:44.258383 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 21/39] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:43 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:44.263903 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3a372387-30ba-491b-8f4c-f90fc1fd6110 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:44.264724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3a372387-30ba-491b-8f4c-f90fc1fd6110 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:44.337800 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3a372387-30ba-491b-8f4c-f90fc1fd6110 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:44.346231 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3a372387-30ba-491b-8f4c-f90fc1fd6110 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1221 microversion: 2.1 time: 0.086322 Dec 15 16:07:44.348891 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 22/40] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:44 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:44.356606 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-19c58cbf-256f-4fb1-8976-8c4a40064b29 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:44.358310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-19c58cbf-256f-4fb1-8976-8c4a40064b29 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:44.441140 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-19c58cbf-256f-4fb1-8976-8c4a40064b29 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:44.458341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-19c58cbf-256f-4fb1-8976-8c4a40064b29 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1237 microversion: 2.1 time: 0.108171 Dec 15 16:07:44.459186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 23/41] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:44 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:44.464323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:44.466749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:44.490642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:44.491332 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:44.493136 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:44.494085 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:44.959292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:44.975530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7deede0e-3df0-4a8b-a531-7be5b6023d84 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.507679 Dec 15 16:07:44.976244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 24/42] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:44 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:45.067801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] validate_networks() for [('b9de569e-dedf-412f-ac55-6fe163ed494a', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:07:45.273802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:45.274366 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:45.288461 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.289153 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.290090 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.290709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.437371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:45.446453 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4c020413-b6a6-4e45-8250-cfcc23b40a73 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.176217 Dec 15 16:07:45.447150 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 25/43] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:45 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:45.451627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:45.452346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:45.458760 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.459338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.460215 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.460944 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.497216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:07:45.497964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:07:45.498570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:07:45.499052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:07:45.499546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:07:45.511049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.511632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.512503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.513123 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.525008 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:45.533060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3e35ef76-553b-4f31-8168-68bec1e78e22 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1225 microversion: 2.1 time: 0.084685 Dec 15 16:07:45.533208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for project f1f1638b13884efc82ff109ef86772d7. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:07:45.533811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 26/44] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:45 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:45.537165 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for user e70e00befa3d41d0b5949f99d36c9b14 and project f1f1638b13884efc82ff109ef86772d7. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:07:45.538503 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:45.539107 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:45.545311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.546104 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.547614 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:45.548126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:45.556055 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:07:45.558838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:07:45.610237 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:45.613228 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a0ce2e55-0a88-4d3c-a5db-d7147e497047 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.836150 Dec 15 16:07:45.614400 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 19/45] 10.222.0.41 () {62 vars in 1187 bytes} [Wed Dec 15 16:07:43 2021] POST /compute/v2.1/servers => generated 401 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:07:45.617599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ba2ff32b-b0c6-45a3-91fe-66505fff41c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1241 microversion: 2.1 time: 0.082610 Dec 15 16:07:45.618351 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 27/46] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:45 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:45.630188 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5f5dd4dc-7aca-4233-a088-357b2aff3218 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:45.630815 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5f5dd4dc-7aca-4233-a088-357b2aff3218 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:45.685332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5f5dd4dc-7aca-4233-a088-357b2aff3218 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:45.693330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5f5dd4dc-7aca-4233-a088-357b2aff3218 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:45.695118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5f5dd4dc-7aca-4233-a088-357b2aff3218 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:45.696378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5f5dd4dc-7aca-4233-a088-357b2aff3218 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1280 microversion: 2.20 time: 0.071667 Dec 15 16:07:45.697004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 20/47] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:45 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:45.992988 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:45.993611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:46.001643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.002497 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.003602 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.004296 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.184105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.194954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-40155a48-f75f-4129-8f1a-94c00418b5fb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.205617 Dec 15 16:07:46.198326 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 28/48] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:45 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:46.463010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:46.463748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:46.470634 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.471111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.471884 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.472317 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.557441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:46.563030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:46.569316 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.569770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.570588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.571059 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.623655 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.634036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b09c878e-6111-4544-8206-cd349d2e0908 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.174491 Dec 15 16:07:46.634847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 21/49] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:46 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:46.636040 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.640354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:46.641052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:46.643778 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a41b3193-b86a-4dc8-939b-cc3bf22cf523 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1225 microversion: 2.1 time: 0.097223 Dec 15 16:07:46.644425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 29/50] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:46 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:46.648917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.649475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.650419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.650924 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.711681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.714807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:46.715411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:46.719772 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ef086aae-b89d-4ccd-bee3-984b248eceaf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1241 microversion: 2.1 time: 0.084144 Dec 15 16:07:46.720472 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 22/51] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:46 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:46.722848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.723300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.724077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:46.724509 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:46.785739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.793886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.795434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:46.796519 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5d6662f2-755c-4ba2-9206-0d3bb9c55a54 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1284 microversion: 2.20 time: 0.085321 Dec 15 16:07:46.797106 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 30/52] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:46 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:07:47.211181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:47.211790 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:47.217546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.217978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.218785 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.219220 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.349425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:47.357543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8e553281-d885-4aeb-acdb-07cf301931b1 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.149918 Dec 15 16:07:47.358181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 23/53] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:47 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:47.651111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:47.651723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:47.681838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:47.682508 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:47.701164 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.701617 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.708686 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.709558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.710021 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.710851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.711298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.711419 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.915960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:47.929176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-717f21a7-0069-4db9-a800-7fbe7d26bcd1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1225 microversion: 2.1 time: 0.268965 Dec 15 16:07:47.930119 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 24/54] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:47 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1225 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:47.937246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:47.938286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:47.949178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.949811 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.951340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:47.951942 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:47.978665 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:47.989333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f633cacd-42b9-4a20-8e70-43cf15a4473d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.342243 Dec 15 16:07:47.990102 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 31/55] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:47 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:47.994801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:47.995471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:48.003245 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:48.004045 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:48.005010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:48.005588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:48.057903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:48.069012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-31e8e208-aafb-4758-8c70-0cb6989a43c6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1233 microversion: 2.1 time: 0.137167 Dec 15 16:07:48.069613 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 25/56] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:47 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1233 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:48.126993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:48.140398 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:48.142613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:48.144160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-480d22e2-933f-4665-8f11-ddf4518a7128 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1276 microversion: 2.20 time: 0.152937 Dec 15 16:07:48.144704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 32/57] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:47 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:48.377926 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:48.378887 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:48.388126 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:48.388769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:48.389667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:48.390234 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:48.947681 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:48.948408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:48.961311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:48.961799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:48.966916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:48.967384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.002201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.010381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a6135d2f-d3b4-4155-8f49-edbf68f9f017 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.639138 Dec 15 16:07:49.014669 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 26/58] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:48 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:49.026250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:49.027048 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:49.052854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:49.054402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.056469 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:49.064656 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.398582 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.408430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c7db726f-9561-42a0-ab7c-af2a98a206e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.391683 Dec 15 16:07:49.411266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 27/59] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:49 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:49.415869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:49.416467 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:49.437549 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.442827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:49.443587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.448696 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:49.450028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.469207 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-406489f1-9fcb-40a9-822e-6ffac551c8ae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1279 microversion: 2.1 time: 0.524759 Dec 15 16:07:49.473847 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 33/60] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:48 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1279 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:49.491095 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:49.494509 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:49.518185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:49.528874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.530514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:49.533144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:49.599491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.607918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-836cd9be-6d5d-4ced-a6c0-eb9615a4c70a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1295 microversion: 2.1 time: 0.195390 Dec 15 16:07:49.610640 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 28/61] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:49 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:49.723222 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.731849 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.733678 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:49.735362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-565c9864-05aa-4b63-ad34-ce998c380a83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1340 microversion: 2.20 time: 0.259306 Dec 15 16:07:49.736055 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 34/62] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:49 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1340 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:50.031492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:50.032262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:50.047728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.048175 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.048966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.049401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.271717 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:50.283561 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7229a393-4b44-43ef-bbf6-2ffdd7a6acfb tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.255131 Dec 15 16:07:50.286565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 29/63] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:50 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:50.446763 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:50.449413 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:50.474576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.480700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.483591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.491907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:50.491907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:50.492351 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.502230 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.508658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.509764 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.514077 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.819101 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:50.826259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f87f0284-d336-4cfc-b496-f4a2a12c188b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.340162 Dec 15 16:07:50.826841 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 30/64] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:50 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:50.836158 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:50.837195 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:50.843265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.844013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.845005 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.845863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.951691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:50.959120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1ed806dc-5f82-4eaf-88c5-b2978bde4bb9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1295 microversion: 2.1 time: 0.126407 Dec 15 16:07:50.960154 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 31/65] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:50 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:50.965510 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:50.966868 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:50.975080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.975837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:50.976976 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:50.977612 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.052509 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:51.065297 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3ba7c6dd-68c6-4a2f-b132-4488cd17a085 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.636776 Dec 15 16:07:51.066577 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 35/66] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:50 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:51.305446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:51.307821 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:51.315025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.316077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.316994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.318333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.450702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:51.467362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:51.471302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:51.473127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-587aef18-84ad-43ca-b604-7c16f5209238 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.511676 Dec 15 16:07:51.473989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 32/67] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:50 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:51.764425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:51.787981 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-98375722-5235-4981-90c6-c6911859ba16 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.488578 Dec 15 16:07:51.799534 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 36/68] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:51 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:51.804451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-fbb4d087-b93e-4bde-8359-76b4b8c904df req-7b9da388-8e75-4f3f-80de-e4087a213aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:51.806306 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:51.806306 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:07:51.821399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-fbb4d087-b93e-4bde-8359-76b4b8c904df req-7b9da388-8e75-4f3f-80de-e4087a213aad service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.822030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-fbb4d087-b93e-4bde-8359-76b4b8c904df req-7b9da388-8e75-4f3f-80de-e4087a213aad service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.841116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-fbb4d087-b93e-4bde-8359-76b4b8c904df req-7b9da388-8e75-4f3f-80de-e4087a213aad service nova] Creating event network-changed:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:07:51.855927 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-fbb4d087-b93e-4bde-8359-76b4b8c904df req-7b9da388-8e75-4f3f-80de-e4087a213aad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054896 Dec 15 16:07:51.856788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 37/69] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:07:51.868195 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:51.869319 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:51.888571 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.889871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.892054 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.893690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.905510 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-a5732e44-062f-4653-9e60-5833fb4814d2 req-c13b877d-7a35-4bbb-a67d-d2eb4d2cda7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0827026d-3f91-4e84-99a5-8aa298069db5", "tag": "2b8a41c5-0444-446c-b2e7-113e3d782222"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:51.909417 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:51.909417 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:07:51.921500 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a5732e44-062f-4653-9e60-5833fb4814d2 req-c13b877d-7a35-4bbb-a67d-d2eb4d2cda7a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.923591 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a5732e44-062f-4653-9e60-5833fb4814d2 req-c13b877d-7a35-4bbb-a67d-d2eb4d2cda7a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.951806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-a5732e44-062f-4653-9e60-5833fb4814d2 req-c13b877d-7a35-4bbb-a67d-d2eb4d2cda7a service nova] Creating event network-changed:2b8a41c5-0444-446c-b2e7-113e3d782222 for instance 0827026d-3f91-4e84-99a5-8aa298069db5 on hv-cinder-80070 Dec 15 16:07:51.952356 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a5732e44-062f-4653-9e60-5833fb4814d2 req-c13b877d-7a35-4bbb-a67d-d2eb4d2cda7a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116081) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:07:51.953823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.954761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.955783 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:51.956403 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:51.966178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.compute.rpcapi [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:07:51.967387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] Releasing lock "compute-rpcapi-router" {{(pid=116081) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:07:52.006230 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-75a097fb-d04e-44cb-92b4-03577b2aad71 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267294 Dec 15 16:07:52.008415 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 33/70] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:07:52.014986 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:52.016634 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:52.024004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.025071 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.027279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.028146 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.194041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.203666 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-eeb88442-b5c3-4f28-a067-e01ad4726902 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.192758 Dec 15 16:07:52.205763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 34/71] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:52 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:52.210543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:52.211177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:52.214113 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.217533 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.218352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.219593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.220170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.223772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-80c2e8bd-c6c7-4ebd-a0d1-3eb29df61dfa tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.363747 Dec 15 16:07:52.224701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 38/72] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:51 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:52.378656 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.386948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fe66e1ab-8df7-464f-854d-cc3d136cdac5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.179929 Dec 15 16:07:52.387524 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 35/73] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:52 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:52.491431 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:52.492044 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:52.497823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.498322 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.499104 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.499757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.716836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.726250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.727985 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.729117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-764a6023-7ef1-40af-8d08-8ffb748e68ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.241396 Dec 15 16:07:52.729853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 39/74] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:52 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:52.805629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:52.806149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:52.813250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.813674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.814492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:52.815084 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:52.961571 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:52.969840 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0a87eb99-d0ef-466e-bca8-acec7c387842 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.167955 Dec 15 16:07:52.970471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 36/75] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:52 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:53.220614 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:53.222241 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:53.235767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.237668 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.237668 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.242629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:53.243238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:53.245888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.249176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.249618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.255387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.255829 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.404643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:53.412000 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-62c6784d-dbbc-4fac-af0a-c1c4eed68c03 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.195131 Dec 15 16:07:53.422084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 40/76] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:53 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:53.422500 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:53.427001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:53.428242 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:53.431065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c2e76d7d-0203-4911-88d5-b0e9e9d62578 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.192225 Dec 15 16:07:53.432451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 37/77] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:53 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:53.435160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.435803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.436582 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.437163 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.644618 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:53.652290 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9d75b10a-a803-4ecd-a9ca-a207992265a0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.228704 Dec 15 16:07:53.656135 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 41/78] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:53 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:53.747273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:53.747965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:53.758974 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.766596 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.767800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:53.773583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:53.988553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:53.989340 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:54.001833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.002862 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.005634 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.006757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.331949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:54.343352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:54.344973 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:54.349462 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-02cec58f-9268-4c6b-b225-9105c306b79b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.602663 Dec 15 16:07:54.351540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 38/79] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:53 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:54.430472 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:54.431496 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:54.439837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.441282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.447285 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.448212 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.756539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:54.764971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1e854d54-aa73-4958-b798-166d396d9256 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.339133 Dec 15 16:07:54.767898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 39/80] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:54 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:54.780171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:54.782516 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:54.812820 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.816374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.817907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.820677 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.879155 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:54.887208 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-48f032e2-13da-4a6b-b8a2-ce4a30c0c4ca tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.903839 Dec 15 16:07:54.887815 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 42/81] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:53 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:54.908052 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:54.908658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:54.937187 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.937641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:54.938470 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:54.938898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:55.243357 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:55.254263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-904b39e4-62c1-4d7b-9e46-f4d38dcdaa50 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.485093 Dec 15 16:07:55.256013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 40/82] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:54 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:55.373023 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:55.376527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:55.402809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:55.404058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:55.405289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:55.406919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:55.601398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:55.610651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:55.613093 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:55.614603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-55428510-da21-4beb-9ece-c3bdae6064a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.247459 Dec 15 16:07:55.627517 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 41/83] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:55 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:55.699718 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:55.710478 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e46a01b8-75e6-49ee-bcd3-89c5f9cbaa98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.811412 Dec 15 16:07:55.711600 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 43/84] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:54 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:55.792134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:55.793249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:55.800753 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:55.801269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:55.802684 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:55.803535 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:55.906324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:55.907013 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:55.919484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:55.926889 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:55.928014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:55.928924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.025517 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.035486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6293bce2-1f07-4046-9889-2e5cb7a318df tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.255018 Dec 15 16:07:56.045442 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 42/85] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:55 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:56.271678 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:56.272558 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:56.278985 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.279668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.280676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.282267 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.478324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.488279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c6f472b0-b720-4f1b-8dc4-0c2b32da5a90 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.220225 Dec 15 16:07:56.498100 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 43/86] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:56 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:56.508265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-8ea8ad44-5945-4a41-93e2-3f5a0dc2fa9b req-a966ec6f-e85c-4b40-a8f5-90f7ff42cb61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0724363-4d41-42f4-83b5-e32a4075c47d", "tag": "bb16d956-defc-4ca5-b835-56a5f772cbb2"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:56.510269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:56.510269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:07:56.519389 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-8ea8ad44-5945-4a41-93e2-3f5a0dc2fa9b req-a966ec6f-e85c-4b40-a8f5-90f7ff42cb61 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.520125 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-8ea8ad44-5945-4a41-93e2-3f5a0dc2fa9b req-a966ec6f-e85c-4b40-a8f5-90f7ff42cb61 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.533897 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-8ea8ad44-5945-4a41-93e2-3f5a0dc2fa9b req-a966ec6f-e85c-4b40-a8f5-90f7ff42cb61 service nova] Creating event network-changed:bb16d956-defc-4ca5-b835-56a5f772cbb2 for instance b0724363-4d41-42f4-83b5-e32a4075c47d on hv-cinder-80070 Dec 15 16:07:56.539131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-8ea8ad44-5945-4a41-93e2-3f5a0dc2fa9b req-a966ec6f-e85c-4b40-a8f5-90f7ff42cb61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035148 Dec 15 16:07:56.540401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 44/87] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:07:56.563794 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.571677 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1512b3bd-870c-4f4a-944e-671dedaea766 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.672082 Dec 15 16:07:56.572308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 44/88] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:55 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:56.633209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:56.633899 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:56.641256 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.641917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.643143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.643751 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.727538 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:56.728286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:56.734067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.734541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.735320 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:56.735744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:56.848284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.856293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.858060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.859347 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5169e6e5-e0fd-41ac-92db-7537c666c4c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.230115 Dec 15 16:07:56.859993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 45/89] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:56 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:56.906016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:56.914034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a86ca60a-74c2-454a-8b19-407774332ccc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.190132 Dec 15 16:07:56.914657 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 45/90] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:56 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:57.052741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:57.053341 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:57.059115 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.059554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.060313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.060741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.192509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:57.199770 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-60e33ac0-8458-49c1-b9ee-eb1096dcab8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.150617 Dec 15 16:07:57.200499 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 46/91] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:57 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:57.505223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:57.506057 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:57.512312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.512755 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.513710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.514171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.588760 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:57.590421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:57.596116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.596559 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.597330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.597754 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.698371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:57.709985 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bbb64624-d71b-485f-a22e-1a4d1308336d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.207788 Dec 15 16:07:57.711823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 46/92] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:57 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:57.743335 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:57.750782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b870c924-19f4-45bf-b3cf-bd73317d20ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.165891 Dec 15 16:07:57.751559 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 47/93] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:57 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:57.876781 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:57.877152 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:57.883353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.883808 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.884593 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.885030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.931248 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:57.932583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:57.939305 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.939894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:57.940956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:57.941578 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.018552 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:58.026883 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:58.028378 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:58.029489 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-27494665-9cb9-445a-a21b-22474015de3d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.156647 Dec 15 16:07:58.030079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 47/94] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:57 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:58.080172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:58.087338 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9c73b35a-5de9-4352-96cb-906856951f31 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.160101 Dec 15 16:07:58.087902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 48/95] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:57 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:58.216418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:58.217017 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:58.223526 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.223964 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.224890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.225466 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.358307 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:58.366802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-57385c1e-522c-41fe-a2b5-4c1346e6c9ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.153958 Dec 15 16:07:58.367376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 48/96] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:58 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:58.570764 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-f75dcd3e-8268-43e6-96d2-c774c5350547 req-7f7851af-1389-4e1b-b6ae-10ca50c3d653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854116b0-a886-4d4c-84c4-092c1f46b5dc", "tag": "ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:58.572688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:58.572688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:07:58.580935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-f75dcd3e-8268-43e6-96d2-c774c5350547 req-7f7851af-1389-4e1b-b6ae-10ca50c3d653 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.581719 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-f75dcd3e-8268-43e6-96d2-c774c5350547 req-7f7851af-1389-4e1b-b6ae-10ca50c3d653 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.593579 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-f75dcd3e-8268-43e6-96d2-c774c5350547 req-7f7851af-1389-4e1b-b6ae-10ca50c3d653 service nova] Creating event network-changed:ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd for instance 854116b0-a886-4d4c-84c4-092c1f46b5dc on hv-cinder-80070 Dec 15 16:07:58.599065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-f75dcd3e-8268-43e6-96d2-c774c5350547 req-7f7851af-1389-4e1b-b6ae-10ca50c3d653 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031374 Dec 15 16:07:58.599667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 49/97] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:07:58.730721 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:58.731610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:58.738900 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.739733 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.740859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.741522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.768118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:58.768963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:58.782316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.790914 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.791835 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:58.792326 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:58.981682 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:58.996157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a9302b2a-ed7e-4a62-8239-bb758ac44ac5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.231785 Dec 15 16:07:59.007603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 50/98] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:58 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:07:59.009185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:59.017162 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4ac070f7-3af6-4e9b-877b-4de49b533fb6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.292666 Dec 15 16:07:59.019637 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 49/99] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:58 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:59.052071 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:59.052825 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:59.061776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.063147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.064162 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.064934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.127440 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-357c7a52-798d-4008-bf64-e39adbb41da0 req-15dbc917-eb97-4e91-841b-504ff3818bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132a29-e694-4b33-b9c1-3be0e2555008", "name": "network-vif-plugged", "status": "completed", "tag": "eb06d20a-14b8-4cc1-8d1b-28c1855f50ed"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:07:59.129118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:59.129118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:07:59.137706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-357c7a52-798d-4008-bf64-e39adbb41da0 req-15dbc917-eb97-4e91-841b-504ff3818bc0 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.138552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-357c7a52-798d-4008-bf64-e39adbb41da0 req-15dbc917-eb97-4e91-841b-504ff3818bc0 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.151379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-357c7a52-798d-4008-bf64-e39adbb41da0 req-15dbc917-eb97-4e91-841b-504ff3818bc0 service nova] Creating event network-vif-plugged:eb06d20a-14b8-4cc1-8d1b-28c1855f50ed for instance 90132a29-e694-4b33-b9c1-3be0e2555008 on hv-cinder-80070 Dec 15 16:07:59.157342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-357c7a52-798d-4008-bf64-e39adbb41da0 req-15dbc917-eb97-4e91-841b-504ff3818bc0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157540 Dec 15 16:07:59.159333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 51/100] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:07:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:07:59.163173 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:59.163875 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:59.172154 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.172782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.173742 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.174371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.296592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:59.307014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:59.315193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:59.316475 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a489f963-ef59-4ac0-b00c-7583f26ce030 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.270924 Dec 15 16:07:59.316900 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:59.317147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 50/101] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:07:59 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:07:59.335932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-632bfc82-a426-4623-b33d-5c0ae36c978b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.176402 Dec 15 16:07:59.345744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 52/102] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:59 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:07:59.383851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:07:59.384536 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:07:59.391371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.391815 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.392578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:07:59.393158 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:07:59.747472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:07:59.755612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-517f6bd2-5245-4d0d-a51d-21de0fb34f1a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.375283 Dec 15 16:07:59.766424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 51/103] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:07:59 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:00.014439 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:00.015043 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:00.021236 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.021616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.022425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.022855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.077129 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:00.078542 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:00.086127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.087263 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.088225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.088817 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.196538 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.204608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c476a82a-f55c-4dc5-aab9-487e8386a459 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.193857 Dec 15 16:08:00.205184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 53/104] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:00 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:00.337021 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:00.338076 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:00.348089 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.348885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.350642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.351291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.507867 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.519934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-03aa0800-aaa9-4254-ab3d-f0257f8bedaf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.446830 Dec 15 16:08:00.522478 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.532081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 52/105] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:00 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:00.533032 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.534623 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.536486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e1d33721-dca0-45c5-b1d2-c5a7c4049581 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.203456 Dec 15 16:08:00.537330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 54/106] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:00 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:08:00.538495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:00.539114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:00.545514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.545960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.547309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.547912 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.720209 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.727718 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-52bea37e-7aee-46ea-bdf1-6d83ba50ff9c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.194572 Dec 15 16:08:00.728314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 53/107] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:00 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:00.772447 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:00.773050 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:00.779142 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.779565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.780413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:00.781381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:00.913602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:00.922374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d94b2275-cd1b-47b4-905f-05f3d4d1b921 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.152725 Dec 15 16:08:00.922881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 55/108] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:00 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:00.994090 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1936580137", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "80656481-ef40-45fb-8d17-1701b01a0b8b"}]}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:01.044263 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] validate_networks() for [('80656481-ef40-45fb-8d17-1701b01a0b8b', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:08:01.173191 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-fbce6b81-8c83-446a-b12a-95817bfd1f44 req-88756b7c-17b1-496e-a954-87c6cf0e375c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771cf51f-79f3-4a84-8ebc-a9497a016143", "name": "network-vif-plugged", "status": "completed", "tag": "fbcf44b9-d476-4aba-a276-c67d0625074b"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:01.175288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:01.175288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:01.185493 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-fbce6b81-8c83-446a-b12a-95817bfd1f44 req-88756b7c-17b1-496e-a954-87c6cf0e375c service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.185950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-fbce6b81-8c83-446a-b12a-95817bfd1f44 req-88756b7c-17b1-496e-a954-87c6cf0e375c service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.198454 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-fbce6b81-8c83-446a-b12a-95817bfd1f44 req-88756b7c-17b1-496e-a954-87c6cf0e375c service nova] Creating event network-vif-plugged:fbcf44b9-d476-4aba-a276-c67d0625074b for instance 771cf51f-79f3-4a84-8ebc-a9497a016143 on hv-cinder-80070 Dec 15 16:08:01.203892 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-fbce6b81-8c83-446a-b12a-95817bfd1f44 req-88756b7c-17b1-496e-a954-87c6cf0e375c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034416 Dec 15 16:08:01.204482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 56/109] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:01.222707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:01.223401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:01.229792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.230572 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.231562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.232328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.377437 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:01.384676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7501a89f-1b8a-4a5f-8db8-871364ed76c6 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.167622 Dec 15 16:08:01.385243 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 57/110] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:01 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:01.537654 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:01.538297 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:01.544317 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.544769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.545552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.546146 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.745574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:01.758070 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7e718707-29c4-4ce7-8423-7b162f1df9eb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.224330 Dec 15 16:08:01.769344 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 58/111] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:01 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:01.773884 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:01.774649 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:01.781150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.781850 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.784388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.784896 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.924819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:08:01.925342 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:08:01.925697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:08:01.926102 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:08:01.926545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:08:01.942445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.942947 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.944046 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.944729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.962498 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:01.966893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Getting quotas for project a663ffafde40436f8ebccd5f5dea55f9. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:08:01.971786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:01.973473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:01.973907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Getting quotas for user 53797e5970544aeababe0d0ecbf68114 and project a663ffafde40436f8ebccd5f5dea55f9. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:08:01.974909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-04bd8542-d44f-4e6f-9d39-c915205b2535 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.207255 Dec 15 16:08:01.975952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 59/112] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:01 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:01.980301 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:01.980892 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:01.987448 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.988063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:01.988981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:01.989589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.009297 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:08:02.011793 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:08:02.079075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-37e83e41-3034-4f02-85e6-a8dfb6716095 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088590 Dec 15 16:08:02.079753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 54/113] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:08:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:08:02.088931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:02.089684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:02.104120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.104581 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.105441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.105886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.165091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:02.173605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c5c868c9-0d90-471b-8893-99fb9cfd10ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.196379 Dec 15 16:08:02.175740 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 60/114] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:01 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:02.180453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a22ea361-c33c-4549-b413-7b17a7075e17 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:02.181124 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a22ea361-c33c-4549-b413-7b17a7075e17 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:02.236185 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a22ea361-c33c-4549-b413-7b17a7075e17 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:02.243239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a22ea361-c33c-4549-b413-7b17a7075e17 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1214 microversion: 2.1 time: 0.066132 Dec 15 16:08:02.250491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 61/115] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:02 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:02.270020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:02.278093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cda97552-93ef-419d-9575-70d5972f0c1d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.194813 Dec 15 16:08:02.278901 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 55/116] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:02 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:02.400948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:02.401569 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:02.407980 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.408418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.409236 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.409602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.542857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:02.550030 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e218f3f3-34e3-445e-92d7-2999eb68fde8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.152670 Dec 15 16:08:02.550627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 62/117] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:02 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:02.776379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:02.776902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:02.783477 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.783957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.784732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.785170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:02.909514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:02.916708 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5603f2fe-380a-4524-a41a-d3f3da3880f1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.144031 Dec 15 16:08:02.917529 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 56/118] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:02 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:02.992344 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:02.992942 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:02.998777 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:02.999216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.000467 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.000892 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.132883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.141173 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.142705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.143911 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dc60142f-55b9-48d3-8316-68f71b803969 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.155110 Dec 15 16:08:03.144347 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 63/119] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:02 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:08:03.191753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:03.192354 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:03.198075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.198556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.199324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.199750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.219209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-940a3167-cdc1-42d7-b065-e0f51b7414a7 req-fd674c48-4e9b-4659-92d6-38b0ea2b07cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0827026d-3f91-4e84-99a5-8aa298069db5", "name": "network-vif-plugged", "status": "completed", "tag": "2b8a41c5-0444-446c-b2e7-113e3d782222"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:03.220934 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:03.220934 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:03.227855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-940a3167-cdc1-42d7-b065-e0f51b7414a7 req-fd674c48-4e9b-4659-92d6-38b0ea2b07cc service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.228480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-940a3167-cdc1-42d7-b065-e0f51b7414a7 req-fd674c48-4e9b-4659-92d6-38b0ea2b07cc service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.239957 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-940a3167-cdc1-42d7-b065-e0f51b7414a7 req-fd674c48-4e9b-4659-92d6-38b0ea2b07cc service nova] Creating event network-vif-plugged:2b8a41c5-0444-446c-b2e7-113e3d782222 for instance 0827026d-3f91-4e84-99a5-8aa298069db5 on hv-cinder-80070 Dec 15 16:08:03.247789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-940a3167-cdc1-42d7-b065-e0f51b7414a7 req-fd674c48-4e9b-4659-92d6-38b0ea2b07cc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Dec 15 16:08:03.248713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 64/120] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:03.260885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:03.261577 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:03.268371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.268819 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.269598 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.270022 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.336014 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.343654 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-04161116-a546-4857-9619-30d4fbbc1cd2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1218 microversion: 2.1 time: 0.087005 Dec 15 16:08:03.353111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 65/121] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:03 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:03.358043 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:03.359227 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:03.365422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.365858 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.366684 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.367194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.537757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.545851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-90140ec2-49e6-4872-bf9c-24c326af7780 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.357413 Dec 15 16:08:03.555774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 57/122] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:03 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:03.566632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:03.567536 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:03.573522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.573977 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.574605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.574830 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.575432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.582726 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-11bb6be6-8314-4f97-8754-80bb8a28bdb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.228227 Dec 15 16:08:03.583392 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 66/123] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:03 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:03.708254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:03.715799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bcf91cb8-15e7-4b3e-be0a-1d5d1f9e9558 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.153362 Dec 15 16:08:03.716371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 58/124] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:03 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:03.933200 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:03.934008 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:03.939809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.940248 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:03.941049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:03.941477 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.078828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.085936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-adfd2536-944b-4985-8ea2-56f522340911 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.156353 Dec 15 16:08:04.086530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 67/125] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:03 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:04.161967 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:04.162611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:04.168681 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.169134 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.169907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.170372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.317907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.328125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.329614 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.330741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e34610c2-1bc0-4ee7-a60b-b0bf641a7408 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.173300 Dec 15 16:08:04.331308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 59/126] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:04 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:04.360804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:04.361566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:04.368183 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.368632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.369541 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.369981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.433051 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.441792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-732e908c-37fb-43da-93d0-6334b87fc86d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1218 microversion: 2.1 time: 0.084937 Dec 15 16:08:04.442395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 68/127] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:04 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:04.564418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:04.565410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:04.572734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.573275 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.574185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.574694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.599695 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:04.600791 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:04.608848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.609339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.610147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.610610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.756456 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.763947 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-68909cbb-d372-42c9-9ef3-463b06d74165 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.167878 Dec 15 16:08:04.764517 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 69/128] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:04 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:04.769490 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:04.770272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:04.776527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.776939 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.777705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:04.778128 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:04.790964 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.800100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-446d93d0-57b1-4d18-b856-24c11b5172d0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1318 microversion: 2.1 time: 0.240649 Dec 15 16:08:04.800677 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 60/129] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:04 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:04.913266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:04.920660 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d79608da-e636-4862-b2d3-b217d329d5b8 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.154457 Dec 15 16:08:04.921709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 70/130] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:04 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:05.102892 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:05.103693 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:05.110362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.110741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.111559 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.111990 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.247761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:05.256923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-628a95df-b1b2-41d2-872b-bf290e2aaf34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.157552 Dec 15 16:08:05.257498 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 61/131] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:05 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:05.350724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:05.351510 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:05.360127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.360628 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.364816 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.364816 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.458825 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:05.459584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:05.469079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.469554 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.470356 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.470786 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.535979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:05.545734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:05.547290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:05.548383 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2ac281d9-59d9-428c-ac92-eb646290c91b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.203661 Dec 15 16:08:05.548932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 71/132] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:05 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:05.580251 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:05.587684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ebc822fc-b134-4cbe-a17d-8bdd3b091d4a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1266 microversion: 2.1 time: 0.132698 Dec 15 16:08:05.588243 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 62/133] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:05 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:05.782683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:05.783827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:05.791140 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.791894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.793201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.793721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.819686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:05.820924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:05.831658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.832353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.833416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.834366 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.956265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:05.964304 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-797b8b8e-2961-4b12-b72d-d7c2e6545e14 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.186960 Dec 15 16:08:05.964885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 72/134] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:05 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:05.969913 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:05.970550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:05.976462 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.977092 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:05.977871 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:05.978336 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.018432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.039770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5e19cbd3-becf-4444-ae04-c772865a0a78 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1507 microversion: 2.1 time: 0.225553 Dec 15 16:08:06.043298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 63/135] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:05 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:06.140339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.149809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-baf7ed50-0498-442d-9b7b-6f8ba6667ec0 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1313 microversion: 2.1 time: 0.183410 Dec 15 16:08:06.150435 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 73/136] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:05 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:06.278896 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:06.280256 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:06.288503 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.289266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.291047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.291756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.568600 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:06.572692 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:06.580159 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.580940 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.582079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.582609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.606877 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.617404 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c88accab-4e12-4d27-ad7b-17b3efb72c7f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.347087 Dec 15 16:08:06.618839 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 64/137] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:06 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:06.624064 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:06.625471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:06.634175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.634720 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.635849 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.636300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.721697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.730034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-839edeb7-a3f0-4374-858d-842628e35bef tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1272 microversion: 2.1 time: 0.109862 Dec 15 16:08:06.731189 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 65/138] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:06 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:06.736547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.745083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.746974 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:06.748197 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8eeb010a-70b5-45ce-a9a6-016a1dc7d3c4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.183536 Dec 15 16:08:06.748769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 74/139] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:06 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:06.985611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:06.987400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:06.996466 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.997218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:06.998488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:06.999139 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.166933 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:07.168126 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:07.175244 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.175686 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.176715 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.177331 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.196259 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:07.208497 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f8ee096d-9e22-4e41-859d-1a0314c995ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.227468 Dec 15 16:08:07.220510 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 66/140] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:06 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:07.332752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:07.340278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d2620165-6db6-49cf-b4fe-ddd3a7321a73 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1500 microversion: 2.1 time: 0.177153 Dec 15 16:08:07.340848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 75/141] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:07 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1500 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:07.608229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88b529a4-e356-4e5b-9080-5a385be851a2"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:07.610723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:07.620940 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.621388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.622188 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.622633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.637940 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:07.639407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:07.650298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.650737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.655898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.656952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.872299 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:07.880235 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-224dc358-e9c8-4cf4-a6f8-f589483d6cbf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.246681 Dec 15 16:08:07.881971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 76/142] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:07 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:07.886445 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:07.887028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:07.893290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.893915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:07.894901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:07.895528 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.102272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:08.112409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-246ca2e8-e5e5-4f74-a8fe-11d9f130ce4b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.229307 Dec 15 16:08:08.113132 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 77/143] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:07 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:08.120773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:08.126915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:08.141863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.142514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.144050 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.144855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.316445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2e0c77c9-5f77-4819-80c0-12faf7a45444 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712570 Dec 15 16:08:08.317152 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 67/144] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:08:07 2021] POST /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:08.334899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-333a763b-a9d9-42b4-aed2-1773e7f240f8 req-93360686-4271-40c6-99ff-f8b72518acb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "name": "network-vif-plugged", "status": "completed", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:08.336975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:08.336975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:08.355302 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-333a763b-a9d9-42b4-aed2-1773e7f240f8 req-93360686-4271-40c6-99ff-f8b72518acb8 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.355971 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-333a763b-a9d9-42b4-aed2-1773e7f240f8 req-93360686-4271-40c6-99ff-f8b72518acb8 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.379145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-333a763b-a9d9-42b4-aed2-1773e7f240f8 req-93360686-4271-40c6-99ff-f8b72518acb8 service nova] Creating event network-vif-plugged:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:08:08.400074 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-333a763b-a9d9-42b4-aed2-1773e7f240f8 req-93360686-4271-40c6-99ff-f8b72518acb8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081446 Dec 15 16:08:08.400960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 68/145] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:08.419196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:08.423533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:08.424543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:08.430702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:08.432753 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:08.434038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4c39a9d9-e2fb-4af5-9472-0d8c432de5a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.319693 Dec 15 16:08:08.445840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.445840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.446363 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.447208 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.447316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 78/146] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:08 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:08.466460 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-a8baac18-12c0-4bfb-b812-6dc991778411 req-6c52395d-5086-4185-b655-090d945201c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dbd72a-95bc-4bed-a421-9f311705b748", "tag": "b3b6ec7e-0199-41d4-a0e9-874d1fe33f9a"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:08.469171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:08.469171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:08.487381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a8baac18-12c0-4bfb-b812-6dc991778411 req-6c52395d-5086-4185-b655-090d945201c8 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.488986 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a8baac18-12c0-4bfb-b812-6dc991778411 req-6c52395d-5086-4185-b655-090d945201c8 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.526377 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-a8baac18-12c0-4bfb-b812-6dc991778411 req-6c52395d-5086-4185-b655-090d945201c8 service nova] Creating event network-changed:b3b6ec7e-0199-41d4-a0e9-874d1fe33f9a for instance 96dbd72a-95bc-4bed-a421-9f311705b748 on hv-cinder-80070 Dec 15 16:08:08.539882 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-a8baac18-12c0-4bfb-b812-6dc991778411 req-6c52395d-5086-4185-b655-090d945201c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083312 Dec 15 16:08:08.543439 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 79/147] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:08.722538 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:08.742027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f8dded4d-b2bd-424b-8a4b-22e723f39992 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.338789 Dec 15 16:08:08.744929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 69/148] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:08 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:08.896680 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:08.897282 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:08.902073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce035b64-56d3-408d-ae8a-661cd84c0f1e"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:08.903249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:08.909425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.909806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.910630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.911059 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.917816 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.918299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:08.919090 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:08.919506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.078228 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:09.085321 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-10330122-20e4-4559-bb2c-2850f3365212 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.192242 Dec 15 16:08:09.085884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 70/149] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:08 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:09.129287 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:09.129833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:09.135939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:09.136390 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.137163 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:09.137609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.309628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:09.318759 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cf93d82e-6efa-4ef3-b6d7-5d30e7cd8e22 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.193375 Dec 15 16:08:09.319498 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 71/150] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:09 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:09.450235 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6fff52eb-c342-4bb6-b611-e7700330e8b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "POST /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.560682 Dec 15 16:08:09.451269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 80/151] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:08:08 2021] POST /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:09.456036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:09.456036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:09.460318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:09.461419 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.462648 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:09.463322 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.691298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:09.699731 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:09.701239 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:09.702572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-05289e5f-99e4-4471-b83c-db264d2c4621 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1405 microversion: 2.20 time: 0.253845 Dec 15 16:08:09.703182 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 72/152] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:09 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:09.762127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:09.763146 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:09.770491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:09.771145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.771935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:09.772438 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:09.911525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:09.919254 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-138dd859-b62e-440e-be3e-c0303cea92c8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.161811 Dec 15 16:08:09.919821 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 81/153] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:09 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:10.102084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:10.102721 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:10.108957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.109620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.110634 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.111072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.257626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:10.265298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4b2f7092-9fb1-44e6-961b-9f205aad1bea tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.166288 Dec 15 16:08:10.265851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 73/154] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:10 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:10.336012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:10.336607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:10.343667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.344118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.344894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.345325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.473152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:10.480451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3dc5034d-e5d1-49f5-bcd9-547529a3db87 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.148083 Dec 15 16:08:10.481017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 82/155] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:10 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:10.486834 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-6ad6306f-dbda-47e8-bbca-0351e3558115 req-a6f8e1c9-4eae-4015-a79e-30ff9799a4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0724363-4d41-42f4-83b5-e32a4075c47d", "name": "network-vif-plugged", "status": "completed", "tag": "bb16d956-defc-4ca5-b835-56a5f772cbb2"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:10.488588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:10.488588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:10.496640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6ad6306f-dbda-47e8-bbca-0351e3558115 req-a6f8e1c9-4eae-4015-a79e-30ff9799a4d2 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.497070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6ad6306f-dbda-47e8-bbca-0351e3558115 req-a6f8e1c9-4eae-4015-a79e-30ff9799a4d2 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.508275 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-6ad6306f-dbda-47e8-bbca-0351e3558115 req-a6f8e1c9-4eae-4015-a79e-30ff9799a4d2 service nova] Creating event network-vif-plugged:bb16d956-defc-4ca5-b835-56a5f772cbb2 for instance b0724363-4d41-42f4-83b5-e32a4075c47d on hv-cinder-80070 Dec 15 16:08:10.513806 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-6ad6306f-dbda-47e8-bbca-0351e3558115 req-a6f8e1c9-4eae-4015-a79e-30ff9799a4d2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030467 Dec 15 16:08:10.514433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 74/156] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:10.719943 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:10.720546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:10.726558 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.727011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.727827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.728259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.855790 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:10.863964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:10.865457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:10.866629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ee60c80d-7820-4e3c-96b2-f478cdf7989a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1597 microversion: 2.20 time: 0.150479 Dec 15 16:08:10.867187 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 83/157] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:08:10 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1597 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:10.885533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:10.886107 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:10.892044 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.892490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.893258 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.893948 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.937859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:10.938506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:10.945015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.945425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.946393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:10.946921 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:10.974575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8a1b2bcb-9b7b-4a72-898b-1b6ba44ffa70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093112 Dec 15 16:08:10.975352 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 75/158] 10.222.0.41 () {60 vars in 1315 bytes} [Wed Dec 15 16:08:10 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:11.092620 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:11.100138 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a6b68bee-4cad-4d30-bc6a-f4597bc91059 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.166623 Dec 15 16:08:11.100846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 84/159] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:10 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:11.283175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:11.284009 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:11.290087 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:11.290581 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:11.291463 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:11.291974 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:11.497655 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:11.498864 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:11.510522 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:11.511789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:11.513148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:11.514410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:11.696724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:11.706489 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-51dd892b-fabe-477b-8753-960e447de062 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.213367 Dec 15 16:08:11.707421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 85/160] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:11 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:12.012479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:12.020984 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-755c6de0-787a-4ddd-9cf5-94dfe653637b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1321 microversion: 2.1 time: 0.742463 Dec 15 16:08:12.021790 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 76/161] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:11 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:12.117228 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:12.117990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:12.126596 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.127038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.127844 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.128275 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.275798 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:12.282949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-84d1e3c7-03bf-4816-93c1-69a733009ce8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.169389 Dec 15 16:08:12.283516 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 86/162] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:12 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:12.529819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-90b89b3f-dfc9-45c7-a58b-50d06f47129f req-61aecafb-ed8c-4999-b4c2-cea5d74951b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854116b0-a886-4d4c-84c4-092c1f46b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:12.531332 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:12.531332 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:12.539235 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-90b89b3f-dfc9-45c7-a58b-50d06f47129f req-61aecafb-ed8c-4999-b4c2-cea5d74951b9 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.539917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-90b89b3f-dfc9-45c7-a58b-50d06f47129f req-61aecafb-ed8c-4999-b4c2-cea5d74951b9 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.554328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-90b89b3f-dfc9-45c7-a58b-50d06f47129f req-61aecafb-ed8c-4999-b4c2-cea5d74951b9 service nova] Creating event network-vif-plugged:ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd for instance 854116b0-a886-4d4c-84c4-092c1f46b5dc on hv-cinder-80070 Dec 15 16:08:12.559480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-90b89b3f-dfc9-45c7-a58b-50d06f47129f req-61aecafb-ed8c-4999-b4c2-cea5d74951b9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 Dec 15 16:08:12.560573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 77/163] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:12.660058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:12.666433 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:12.676595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-0233c52a-81be-464f-b19d-5fccc8c98739 req-18220153-939a-410f-b596-fc79fd5c7137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:12.680725 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:12.680725 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:12.694081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-0233c52a-81be-464f-b19d-5fccc8c98739 req-18220153-939a-410f-b596-fc79fd5c7137 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.695279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-0233c52a-81be-464f-b19d-5fccc8c98739 req-18220153-939a-410f-b596-fc79fd5c7137 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.701157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.705501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.709319 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.710297 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.711205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-0233c52a-81be-464f-b19d-5fccc8c98739 req-18220153-939a-410f-b596-fc79fd5c7137 service nova] Creating event network-changed:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:08:12.722868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-0233c52a-81be-464f-b19d-5fccc8c98739 req-18220153-939a-410f-b596-fc79fd5c7137 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054536 Dec 15 16:08:12.724890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 78/164] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:12.733160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:12.734559 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:12.742803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.744626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.745956 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:12.746760 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:12.798442 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d6608b28-f152-4a0a-b776-77e06c748688 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.142665 Dec 15 16:08:12.799840 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 87/165] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:12 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:13.040014 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:13.040963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:13.050339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.053642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:13.054223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.057867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.058440 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.063626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-91cbaee3-c350-4d84-8674-c6710d9ec3a4 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.336253 Dec 15 16:08:13.064120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 79/166] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:12 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:13.272565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:13.282245 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5f2dfcaf-a83b-40f3-b078-eef0f58c283c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1515 microversion: 2.1 time: 0.246320 Dec 15 16:08:13.283104 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 88/167] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:13 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:13.300353 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:13.301144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:13.302334 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:13.302444 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:13.313086 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.314857 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.315842 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.317604 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.320232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.322361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.323488 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.326504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.366325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lazy-loading 'flavor' on Instance uuid b0724363-4d41-42f4-83b5-e32a4075c47d {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:08:13.581210 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-077c23c2-eb36-445a-bcd5-d6220f6007ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d/action" status: 200 len: 32 microversion: 2.1 time: 0.285678 Dec 15 16:08:13.585787 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 80/168] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:13 2021] POST /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d/action => generated 32 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:13.602097 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:13.605672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:13.613549 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:13.617600 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.618285 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.619262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.619883 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.626767 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0aa500aa-462b-45be-b537-52e5ca071018 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.330281 Dec 15 16:08:13.630210 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 89/169] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:13 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:13.809033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:13.810272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:13.823114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.823905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.825017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:13.825257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:13.927928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d65e721d-135e-4474-8b4f-a45f5740b782 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.122523 Dec 15 16:08:13.932049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 90/170] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:13 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:14.048451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:14.064592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1cac92cb-9ffa-4d5a-a72a-d2a7a0e0663f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.466461 Dec 15 16:08:14.067756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 81/171] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:13 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:14.081282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:14.081956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:14.089253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:14.089883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:14.090862 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:14.091455 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:14.298837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:14.308885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7e6f28f2-1b96-45f3-a1cc-7ac801d9f05b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.230365 Dec 15 16:08:14.309733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 91/172] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:14 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:14.645387 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:14.646855 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:14.658346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:14.658795 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:14.660540 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:14.662601 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:14.943049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:14.948435 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:14.955698 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:14.956203 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:14.957166 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:14.957741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:14.974719 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:14.982138 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c1e5cdf9-adde-4903-bec5-7e5ef619f82c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1362 microversion: 2.1 time: 0.341134 Dec 15 16:08:14.993768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 82/173] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:14 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:15.064056 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-69d03b29-cedc-4e86-9ac2-bf29820ad523 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.129799 Dec 15 16:08:15.065211 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 92/174] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:14 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:15.083388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:15.084066 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:15.091879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:15.092355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:15.093581 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:15.094102 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:15.235076 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:15.243289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0e011f5d-ca90-48de-bd5c-1b85d6bcc6fc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.163492 Dec 15 16:08:15.244070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 83/175] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:15 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:15.326806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:15.327519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:15.334607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:15.337118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:15.338073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:15.338691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:15.532484 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:15.540727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-60949451-d3d2-4024-86cb-29b41010d44f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.217635 Dec 15 16:08:15.542349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 93/176] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:15 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:16.000605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:16.001493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:16.008236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.008682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.009487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.009915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.075219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:16.076209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:16.084068 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.084815 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.085707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.086273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.163988 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b018218a-6fc8-495d-be74-08f007e3f0fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.092720 Dec 15 16:08:16.164718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 94/177] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:16 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:16.207403 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:16.214640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-39235b14-86d9-48a7-aa28-c4c059dc2f05 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1547 microversion: 2.1 time: 0.217844 Dec 15 16:08:16.215220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 84/178] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:15 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:16.232570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:16.233158 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:16.239914 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.240359 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.241135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.241569 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.260483 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:16.261474 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:16.268448 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.268996 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.269898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.270639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.331487 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-948b7f49-5774-4fa9-9b03-e03902c603be tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102820 Dec 15 16:08:16.332587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 95/179] 10.222.0.41 () {58 vars in 1274 bytes} [Wed Dec 15 16:08:16 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:16.447873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:16.457246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a7b4b97f-67d2-4267-91d9-606d9b9e4c43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.200186 Dec 15 16:08:16.458072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 85/180] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:16 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:16.567417 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:16.568413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:16.574647 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.575269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:16.576223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:16.576651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:17.160206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:17.167652 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7b758c72-3478-46db-89ea-c0526d169a0e tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.611065 Dec 15 16:08:17.168219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 96/181] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:16 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:17.176958 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:17.178265 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:17.189219 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:17.189723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:17.191257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:17.192408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:17.283745 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-dc35bfde-73f6-46ce-92db-d115ecf83861 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.111169 Dec 15 16:08:17.284400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 86/182] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:17 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:17.404366 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-743545490", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "759c34f4-14be-417a-897c-06d30e0fd249"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:17.462971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] validate_networks() for [('759c34f4-14be-417a-897c-06d30e0fd249', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:08:17.475934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:17.476635 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:17.484432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:17.484826 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:17.485744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:17.486219 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:17.632191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:17.641731 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0c7ad69d-a069-4c30-8139-d92492263d58 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.170158 Dec 15 16:08:17.642588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 87/183] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:17 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:17.787181 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-31304601-ef68-4b48-876b-56fa867d4bf2 req-ae29a838-4f35-42ed-9b85-e33fda9debb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dbd72a-95bc-4bed-a421-9f311705b748", "name": "network-vif-plugged", "status": "completed", "tag": "b3b6ec7e-0199-41d4-a0e9-874d1fe33f9a"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:17.788704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:17.788704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:17.796328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-31304601-ef68-4b48-876b-56fa867d4bf2 req-ae29a838-4f35-42ed-9b85-e33fda9debb5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:17.796990 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-31304601-ef68-4b48-876b-56fa867d4bf2 req-ae29a838-4f35-42ed-9b85-e33fda9debb5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:17.809059 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-31304601-ef68-4b48-876b-56fa867d4bf2 req-ae29a838-4f35-42ed-9b85-e33fda9debb5 service nova] Creating event network-vif-plugged:b3b6ec7e-0199-41d4-a0e9-874d1fe33f9a for instance 96dbd72a-95bc-4bed-a421-9f311705b748 on hv-cinder-80070 Dec 15 16:08:17.814354 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-31304601-ef68-4b48-876b-56fa867d4bf2 req-ae29a838-4f35-42ed-9b85-e33fda9debb5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Dec 15 16:08:17.815164 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 88/184] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:18.160930 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:08:18.161075 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:08:18.161642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:08:18.162143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:08:18.162707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:08:18.183934 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.184478 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.185409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.188315 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:18.188783 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.189629 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:18.200931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.202920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.206078 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.206716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.251800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:08:18.257054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for user 50f2f5e4390046308cce9ef7ab394abd and project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:08:18.270221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:08:18.273437 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:08:18.330028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4c91e680-862a-4cc3-bc3e-c42b2d67dec1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929722 Dec 15 16:08:18.330778 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 97/185] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:08:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:08:18.336303 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:18.337687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:18.364572 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.370982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.372311 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.372759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.422806 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:18.434547 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-050b8963-84ba-4449-8fdb-40d0431261e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.252655 Dec 15 16:08:18.435457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 89/186] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:18 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:18.445047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-b05e332a-0f4e-48df-bc5c-e1438463f5d5 req-8d723615-8b7f-4092-9c07-92a569b6dec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854116b0-a886-4d4c-84c4-092c1f46b5dc", "tag": "ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:18.449854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:18.449854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:18.457870 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-b05e332a-0f4e-48df-bc5c-e1438463f5d5 req-8d723615-8b7f-4092-9c07-92a569b6dec4 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.458670 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-b05e332a-0f4e-48df-bc5c-e1438463f5d5 req-8d723615-8b7f-4092-9c07-92a569b6dec4 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.466582 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2d8f13ea-5db4-4631-9a78-dbba820ee7b3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.134211 Dec 15 16:08:18.468222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 98/187] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:18 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:18.475537 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:18.476562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:18.477669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-b05e332a-0f4e-48df-bc5c-e1438463f5d5 req-8d723615-8b7f-4092-9c07-92a569b6dec4 service nova] Creating event network-changed:ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd for instance 854116b0-a886-4d4c-84c4-092c1f46b5dc on hv-cinder-80070 Dec 15 16:08:18.483783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-b05e332a-0f4e-48df-bc5c-e1438463f5d5 req-8d723615-8b7f-4092-9c07-92a569b6dec4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046320 Dec 15 16:08:18.484488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 90/188] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:18.489802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9e19e80b-f6a7-455a-970a-3249359cbbe6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:18.490573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9e19e80b-f6a7-455a-970a-3249359cbbe6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:18.497240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.497687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.498587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.499758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.603663 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9e19e80b-f6a7-455a-970a-3249359cbbe6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:18.611527 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9e19e80b-f6a7-455a-970a-3249359cbbe6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1217 microversion: 2.1 time: 0.125801 Dec 15 16:08:18.612293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 91/189] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:18 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:18.660134 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:18.661149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:18.662686 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e9a440ba-909b-4c8e-999e-3f7d2fe33970 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.192474 Dec 15 16:08:18.666242 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 99/190] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:18 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:18.675034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.675739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.676528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:18.676955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:18.861220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:18.869487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6f52cf73-3194-4fa3-9ff1-c4a1deed26bb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.214356 Dec 15 16:08:18.870364 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 92/191] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:18 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:19.461220 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:19.461918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:19.469604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.470228 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.470846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.471538 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.481016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:19.488486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:19.511793 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.512978 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.513848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.514338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.672891 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4d627658-9c27-4a62-a9c3-ff952b7f6ed6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.197633 Dec 15 16:08:19.673715 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 93/192] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:19 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:19.680124 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:19.681990 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:19.693751 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.694695 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.696471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.698909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.797082 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:19.805868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-833c7f1f-81d2-45e9-b03f-b976aca3dfe8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1269 microversion: 2.1 time: 0.130250 Dec 15 16:08:19.806486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 94/193] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:19 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1269 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:19.821914 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:19.822924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:19.829816 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.830578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.831540 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.832144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.861697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:19.876195 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a6af4e33-5c16-4bd2-9aaf-368ef464a59a tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1314 microversion: 2.1 time: 0.420230 Dec 15 16:08:19.876835 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 100/194] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:19 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:19.887857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:19.889213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:19.895397 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.896271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.897171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:19.897674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:19.942753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-89a263ba-84cd-482b-86a4-20643a793a07 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.134640 Dec 15 16:08:19.943677 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 95/195] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:19 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:20.111308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:20.120827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c6508011-484c-4816-890e-815b3f299740 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.236817 Dec 15 16:08:20.121865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 101/196] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:19 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:20.685269 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:20.688821 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:20.695548 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:20.696211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:20.698121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:20.698744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:20.786053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-518738d0-229c-421a-9e7f-8bc132cbb803 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.106229 Dec 15 16:08:20.789196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 96/197] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:20 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:20.824720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:20.825276 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:20.832279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:20.832722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:20.833501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:20.833931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:20.894310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:20.895514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:20.903631 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:20.904484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:20.905484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:20.905922 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:20.974962 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:20.982214 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-54f9c675-1f0d-4397-9a9c-7d4006cbd0a8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.161745 Dec 15 16:08:20.982793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 102/198] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:20 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:20.999315 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:21.000346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:21.006509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.007149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.008265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.008855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.093795 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f44e74f4-b789-487f-867a-6244516ba84f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.108427 Dec 15 16:08:21.094883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 103/199] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:20 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:21.141192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:21.141992 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:21.145563 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:21.150364 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.151120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.152160 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.152779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.156504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-00619058-aa78-4ad6-97ba-62d92c107c41 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1498 microversion: 2.1 time: 0.264317 Dec 15 16:08:21.157223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 97/200] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:20 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:21.426819 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:21.446763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a75bcfb5-5455-474a-b57a-ab83d54f5ba2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.311507 Dec 15 16:08:21.448870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 104/201] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:21 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:21.448983 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-23747893-0479-498c-8db3-8072ec608951 req-c44dd4fd-9db7-4381-a757-49d79f8abd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6231c6b-54bb-4377-9bea-f01ed2db96b2", "tag": "137a78e4-d3b4-44b0-b61b-952fe0b633ba"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:21.450761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:21.450761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:21.460736 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-23747893-0479-498c-8db3-8072ec608951 req-c44dd4fd-9db7-4381-a757-49d79f8abd70 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.462019 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-23747893-0479-498c-8db3-8072ec608951 req-c44dd4fd-9db7-4381-a757-49d79f8abd70 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.484892 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-23747893-0479-498c-8db3-8072ec608951 req-c44dd4fd-9db7-4381-a757-49d79f8abd70 service nova] Creating event network-changed:137a78e4-d3b4-44b0-b61b-952fe0b633ba for instance b6231c6b-54bb-4377-9bea-f01ed2db96b2 on hv-cinder-80070 Dec 15 16:08:21.495219 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-23747893-0479-498c-8db3-8072ec608951 req-c44dd4fd-9db7-4381-a757-49d79f8abd70 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051354 Dec 15 16:08:21.496079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 98/202] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:21.801919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:21.803597 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:21.807788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:21.808556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:21.812809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.813589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.814567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.815895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.820521 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.820979 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.822149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:21.823803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:21.874017 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:08:21.909154 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ee22175d-713a-43b0-92ff-c79d0864eb68 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.110694 Dec 15 16:08:21.910085 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 105/203] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:21 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:22.000339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:22.001352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:22.011339 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b5cb60aa-6ba5-4510-a75f-cbd4dfa9ede9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "DELETE /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 204 len: 0 microversion: 2.1 time: 0.212559 Dec 15 16:08:22.012213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 99/204] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:08:21 2021] DELETE /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:08:22.015727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.016333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.017174 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.017782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.020954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:22.021641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:22.028925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.029375 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.030255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.030694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.224622 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:22.235707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8c46e9a6-1de3-4bc0-aa09-343dc3945f98 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.239990 Dec 15 16:08:22.236482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 106/205] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:21 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:22.242334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:22.243427 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:22.253081 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.253801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.254961 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.256257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.339089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:22.348407 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b79b759c-c2e2-4b93-a317-b75284625dc3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1504 microversion: 2.1 time: 0.328562 Dec 15 16:08:22.348407 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 100/206] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:22 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:22.348705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-858f34c8-f378-42be-895f-2e453d27bbe4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.107334 Dec 15 16:08:22.348705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 107/207] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:22 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:22.468038 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:22.468997 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:22.475662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.476392 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.477386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.477982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.721416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:22.729386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-777ef8d0-1cf8-4222-af4c-b35cb0c9d1bf tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.265621 Dec 15 16:08:22.743175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 101/208] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:22 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:22.929952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:22.931823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:22.943579 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.944372 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:22.945348 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:22.946503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.044989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c0f79925-c78f-40c6-bee8-4598ec1f0acf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.127480 Dec 15 16:08:23.046167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 108/209] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:22 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:23.253466 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:23.254075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:23.260166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.260617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.261409 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.261859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.364140 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:23.365393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:23.382586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.383213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.384171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.384604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.489836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-722bc6d5-0ec0-41fb-8d13-31b451034a76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.130622 Dec 15 16:08:23.493837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 109/210] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:23 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:23.496843 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:23.501730 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:23.506368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:23.510723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-54260991-bb31-4a4d-8434-016bc28c4924 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.260983 Dec 15 16:08:23.511305 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 102/211] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:23 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:23.518770 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.519552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.520530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.521787 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.749789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:23.750482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:23.757675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.758285 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.759311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:23.760085 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:23.804259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:23.825866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-385ef342-2b46-48c6-b1f4-df0112b5e7e8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1504 microversion: 2.1 time: 0.330504 Dec 15 16:08:23.827177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 110/212] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:23 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:24.056204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:24.057170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:24.080010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.080767 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.081856 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.082593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.188850 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-854fc86b-a187-4801-887f-13a5183e6c0d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.133881 Dec 15 16:08:24.189311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:24.189610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 111/213] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:24 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:08:24.201229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d438f8e7-12ce-449d-b347-baf8e03d52e7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.456006 Dec 15 16:08:24.203982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 103/214] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:23 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:24.502873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:24.504350 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:24.517918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.522274 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.528976 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:24.530779 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:24.538926 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.539480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.540178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.550196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.554703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.555655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.709481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e8d700f9-2b51-40ca-bd68-9b5ae5b847ae tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.211945 Dec 15 16:08:24.710997 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 112/215] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:24 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:24.845419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:24.846130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:24.865962 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.866445 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:24.867252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:24.867684 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.187127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:25.197379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-928fa4f9-694b-42d6-8a95-d185025d6df9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1504 microversion: 2.1 time: 0.357591 Dec 15 16:08:25.208675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 113/216] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:24 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:25.212479 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:25.213936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:25.231636 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.232151 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.235512 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.236905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.275486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:08:25.384311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:25.392725 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8cc8b655-92e6-4bfb-ae6a-229948100aa3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.867522 Dec 15 16:08:25.395238 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 104/217] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:24 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:25.401244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:25.402411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:25.411215 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.412013 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.413005 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.413706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.462200 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1fb0a245-5ef1-4018-a6e4-ae4cd1039860 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "DELETE /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 204 len: 0 microversion: 2.1 time: 0.258597 Dec 15 16:08:25.466109 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 114/218] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:08:25 2021] DELETE /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:08:25.470552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:25.471683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:25.481041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.481574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.482693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.483821 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.532562 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c479a272-8f6f-4bb4-9b1e-17d774518f88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.135491 Dec 15 16:08:25.534144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 105/219] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:25 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:25.544911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:25.547775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:25.566293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.566791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.567895 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.568328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.904324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:25.917429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9f034522-d78f-4fda-b151-ab9dd65e4102 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.451406 Dec 15 16:08:25.918869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 115/220] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:25 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:25.923587 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:25.939783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-dd67e4be-1b6d-48d4-8560-6525a86d0148 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1552 microversion: 2.1 time: 0.403400 Dec 15 16:08:25.943038 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 106/221] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:25 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1552 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:25.945654 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:25.947383 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:25.956389 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.956828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:25.957725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:25.958122 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.090363 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0d4aeef8-15f8-4888-a4df-4c1ee6cbc7b6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.157289 Dec 15 16:08:26.091346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 116/222] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:25 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:26.173312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-e5b98089-acf5-4a7f-8237-af0ec89d91ab req-f6cb8911-0677-456e-80dc-95c3fcd7b13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dbd72a-95bc-4bed-a421-9f311705b748", "name": "network-vif-deleted", "tag": "b3b6ec7e-0199-41d4-a0e9-874d1fe33f9a"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:26.178874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:26.178874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:26.195234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-e5b98089-acf5-4a7f-8237-af0ec89d91ab req-f6cb8911-0677-456e-80dc-95c3fcd7b13d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.198840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-e5b98089-acf5-4a7f-8237-af0ec89d91ab req-f6cb8911-0677-456e-80dc-95c3fcd7b13d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.216879 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:26.218435 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:26.223043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-e5b98089-acf5-4a7f-8237-af0ec89d91ab req-f6cb8911-0677-456e-80dc-95c3fcd7b13d service nova] Creating event network-vif-deleted:b3b6ec7e-0199-41d4-a0e9-874d1fe33f9a for instance 96dbd72a-95bc-4bed-a421-9f311705b748 on hv-cinder-80070 Dec 15 16:08:26.227838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.228284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.229467 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.229885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.234545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-e5b98089-acf5-4a7f-8237-af0ec89d91ab req-f6cb8911-0677-456e-80dc-95c3fcd7b13d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064816 Dec 15 16:08:26.236724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 107/223] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:26.354048 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:26.362707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5438914e-e4e9-4e13-87f5-1c8d58a7dfe8 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 200 len: 1299 microversion: 2.1 time: 0.150245 Dec 15 16:08:26.363317 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 117/224] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:26 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:26.412103 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:26.413079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:26.424115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.427653 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.429073 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.430789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.577290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:26.578247 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:26.591609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.591986 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.592819 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.593251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.678876 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:26.688426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5f059486-9fe0-41ff-aeea-518b78948642 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.280673 Dec 15 16:08:26.689190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 108/225] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:26 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:26.724407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6606692e-aa2e-4d59-a58a-1908c398db3d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.182458 Dec 15 16:08:26.728322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 118/226] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:26 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:26.936732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:26.937151 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:26.944232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.944682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.945475 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.945913 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.968813 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:26.970049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:26.986183 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.988028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:26.989448 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:26.991397 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.247527 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:27.255035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0c925056-8a7a-49d1-bbcd-3f3c461ff604 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.322589 Dec 15 16:08:27.255620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 109/227] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:26 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:27.265595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:27.265595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:27.269617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.270067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.271032 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.271477 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.350253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:27.361211 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cb90fb25-3053-477e-9b07-bd21c2a43a78 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1552 microversion: 2.1 time: 0.405380 Dec 15 16:08:27.364951 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 119/228] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:26 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1552 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:27.379807 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:27.380421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 96dbd72a-95bc-4bed-a421-9f311705b748] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:27.392874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.393326 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.393892 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-523bdc07-985e-4bd8-9267-b8ecc8e12808 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.136647 Dec 15 16:08:27.394118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.394580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.395031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 110/229] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:27 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:27.426731 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] HTTP exception thrown: Instance 96dbd72a-95bc-4bed-a421-9f311705b748 could not be found. Dec 15 16:08:27.427336 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Returning 404 to user: Instance 96dbd72a-95bc-4bed-a421-9f311705b748 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:27.428171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9bee475d-01ed-4ea6-b72f-e9ed657477ca tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748" status: 404 len: 111 microversion: 2.1 time: 0.052103 Dec 15 16:08:27.428736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 120/230] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:27 2021] GET /compute/v2.1/servers/96dbd72a-95bc-4bed-a421-9f311705b748 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:27.600293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1615081790", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "80656481-ef40-45fb-8d17-1701b01a0b8b"}]}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:27.664194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] validate_networks() for [('80656481-ef40-45fb-8d17-1701b01a0b8b', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:08:27.709161 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:27.710550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:27.719404 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.720110 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.721055 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.721650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.899012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:27.911133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9281c555-de3c-4044-be01-2e345cba7edd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.206509 Dec 15 16:08:27.922776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 121/231] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:27 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:27.924772 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:27.925261 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:27.933133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.933578 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:27.934399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:27.934826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.021046 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b61ac073-affc-4b82-b061-a14a7463dc34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.100049 Dec 15 16:08:28.023050 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 122/232] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:27 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:28.083101 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:08:28.084045 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:08:28.084669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:08:28.085070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:08:28.085474 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:08:28.101446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.102109 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.102884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.103413 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.157819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Getting quotas for project a663ffafde40436f8ebccd5f5dea55f9. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:08:28.162909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Getting quotas for user 53797e5970544aeababe0d0ecbf68114 and project a663ffafde40436f8ebccd5f5dea55f9. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:08:28.174943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:08:28.177505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:08:28.266996 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-16407c9e-5f35-4afe-97ba-f6098803f384 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669214 Dec 15 16:08:28.272495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 111/233] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:08:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:08:28.273525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:28.274428 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:28.277433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bf781414-bd63-44cf-8e7d-ce3487a0a039 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:28.278645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bf781414-bd63-44cf-8e7d-ce3487a0a039 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:28.285385 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.285968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.286789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.287411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.368200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bf781414-bd63-44cf-8e7d-ce3487a0a039 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:28.377694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bf781414-bd63-44cf-8e7d-ce3487a0a039 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1214 microversion: 2.1 time: 0.104080 Dec 15 16:08:28.378292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 112/234] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:28 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:28.388837 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:28.389703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:28.396249 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.396615 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.399161 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.400766 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.591005 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:28.612251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dd206e38-6d79-45e8-8847-eb343e7eb249 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.343274 Dec 15 16:08:28.614543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 123/235] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:28 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:28.623216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:28.631592 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:28.645138 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.645839 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.647204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.647854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.730715 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-08192063-f18a-4956-be80-0d0ddc44cf94 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.112342 Dec 15 16:08:28.731675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 124/236] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:28 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:28.817934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:28.830435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fdf524d6-df95-435a-ae91-cdb78688abcf tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1552 microversion: 2.1 time: 0.444553 Dec 15 16:08:28.831389 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 113/237] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:28 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1552 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:28.930942 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:28.931895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:28.940430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.941130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:28.942062 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:28.942657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.034262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:29.036338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:29.043380 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.043826 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.044609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.045035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.112559 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:29.121391 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c6d26c5f-7d17-4ffa-8aad-9a6adc43ab00 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.194023 Dec 15 16:08:29.122463 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 125/238] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:28 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:29.160982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c0efdcac-579f-42f5-8ad1-b8ccc694f2dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.131355 Dec 15 16:08:29.162089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 114/239] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:29 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:08:29.397630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:29.398747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:29.415021 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.417964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.418867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.419310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.629929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:29.630544 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:29.642390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:29.652398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-25a6a02f-d877-4816-88cc-1ce5b57548eb tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1266 microversion: 2.1 time: 0.261058 Dec 15 16:08:29.652720 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.657167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 126/240] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:29 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:29.657966 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.659045 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.659805 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.709898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-3f03c14a-b96c-44d0-ab01-587ce6b3871e req-38afa9ea-eb35-4280-86d6-15a7bbbc2c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771cf51f-79f3-4a84-8ebc-a9497a016143", "name": "network-vif-deleted", "tag": "fbcf44b9-d476-4aba-a276-c67d0625074b"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:29.711744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:29.711744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:29.727429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-3f03c14a-b96c-44d0-ab01-587ce6b3871e req-38afa9ea-eb35-4280-86d6-15a7bbbc2c64 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.728352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-3f03c14a-b96c-44d0-ab01-587ce6b3871e req-38afa9ea-eb35-4280-86d6-15a7bbbc2c64 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.754576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-3f03c14a-b96c-44d0-ab01-587ce6b3871e req-38afa9ea-eb35-4280-86d6-15a7bbbc2c64 service nova] Creating event network-vif-deleted:fbcf44b9-d476-4aba-a276-c67d0625074b for instance 771cf51f-79f3-4a84-8ebc-a9497a016143 on hv-cinder-80070 Dec 15 16:08:29.759983 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-3f03c14a-b96c-44d0-ab01-587ce6b3871e req-38afa9ea-eb35-4280-86d6-15a7bbbc2c64 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053984 Dec 15 16:08:29.761127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 127/241] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:29.767189 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:29.768457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:29.775955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.776728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.777657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.778302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.895046 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7185e490-8054-49ed-a625-f3b68ff41d5b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 14 microversion: 2.20 time: 0.132138 Dec 15 16:08:29.895993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 128/242] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:29 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:29.900770 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:29.901454 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:29.922994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.923455 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:29.924569 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:29.928810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.069944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7767b34fd0a49adbbfaf004bbb64a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc182f1b5d374414ba1fa8c369cf6372', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:30.081370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b2dc8337-da60-46e2-ab14-e28993f79165 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 200 len: 1344 microversion: 2.1 time: 0.183698 Dec 15 16:08:30.082867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 129/243] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:29 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 1344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:30.153246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:30.156722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:30.176326 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.177788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:30.180184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.185703 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.187240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.188917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-36c071ce-1385-4798-b7ba-c029fe39805f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.563479 Dec 15 16:08:30.190603 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 115/244] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:29 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:30.204399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:30.207503 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:30.220286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.220735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.221541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.221979 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.329446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-02dbe391-188d-4958-913c-e0d6c67719ec tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.135917 Dec 15 16:08:30.330227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 116/245] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:30 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:30.674174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:30.674791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:30.682428 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.687655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.696093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.696761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.750785 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:30.762232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5cfa0598-bcdc-4587-9aea-bc734f5b986c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.622593 Dec 15 16:08:30.775924 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 130/246] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:30 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:30.794428 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-d2baac85-7ac5-4e26-acc7-b4acbfa77529 req-c6a03de9-90d5-4699-8a49-5481317eff53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6231c6b-54bb-4377-9bea-f01ed2db96b2", "name": "network-vif-plugged", "status": "completed", "tag": "137a78e4-d3b4-44b0-b61b-952fe0b633ba"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:30.797567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:30.797567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:30.807702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-d2baac85-7ac5-4e26-acc7-b4acbfa77529 req-c6a03de9-90d5-4699-8a49-5481317eff53 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.808519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-d2baac85-7ac5-4e26-acc7-b4acbfa77529 req-c6a03de9-90d5-4699-8a49-5481317eff53 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.821626 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-d2baac85-7ac5-4e26-acc7-b4acbfa77529 req-c6a03de9-90d5-4699-8a49-5481317eff53 service nova] Creating event network-vif-plugged:137a78e4-d3b4-44b0-b61b-952fe0b633ba for instance b6231c6b-54bb-4377-9bea-f01ed2db96b2 on hv-cinder-80070 Dec 15 16:08:30.844038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-d2baac85-7ac5-4e26-acc7-b4acbfa77529 req-c6a03de9-90d5-4699-8a49-5481317eff53 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052313 Dec 15 16:08:30.847912 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 131/247] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:30.867300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:30.875685 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0d170f26-b1e3-4f95-b1a4-ec1071fb5ff3 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1272 microversion: 2.1 time: 0.205418 Dec 15 16:08:30.886462 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 117/248] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:30 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:30.909116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:30.910830 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:30.924328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.924809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:30.935354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:30.935947 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.064699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7b9fe7f3-f2cb-4bfe-aec7-8fc37cb88065 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 2582 microversion: 2.20 time: 0.162482 Dec 15 16:08:31.065341 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 132/249] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:30 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 2582 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:08:31.099203 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:31.100279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:31.107216 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.107915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.108868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.109476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.133036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] HTTP exception thrown: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. Dec 15 16:08:31.133691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Returning 404 to user: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:31.134782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-053feeb9-371c-44fd-b194-15958e4969ba tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 404 len: 111 microversion: 2.1 time: 0.039257 Dec 15 16:08:31.135855 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 118/250] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:31 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:31.208843 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:31.209582 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:31.222632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.223033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.224033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.224680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.341027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:31.343612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:31.355846 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.356578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.359724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.360362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.489255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4ebf2d26-bb6d-4616-bc6f-17c1816d4a15 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.152010 Dec 15 16:08:31.492330 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 119/251] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:31 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:31.495454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:31.496558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:31.513209 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.513724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.515155 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.515588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.552450 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] HTTP exception thrown: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. Dec 15 16:08:31.553064 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Returning 404 to user: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:31.553901 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cc1f8040-6be5-4828-9636-7699702f2961 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062359 Dec 15 16:08:31.554508 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 120/252] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:08:31 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:31.698317 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:31.709272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2ff5fd97-31ab-49b4-b74d-b241cf318f2f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.505386 Dec 15 16:08:31.712887 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 133/253] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:31 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:31.783199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:31.785146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:31.804452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.805619 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.806802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.810114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.893486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:31.894754 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:31.907482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.908225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:31.909193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:31.909774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.157940 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:32.169510 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d56dbd69-ca67-407f-9a68-816abef7561d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1317 microversion: 2.1 time: 0.390915 Dec 15 16:08:32.172079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 121/254] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:31 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:32.177125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:32.178594 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:32.194602 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.195355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.196539 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.197230 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.319978 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1aef5fa9-38dc-4629-9cf9-a88d800b5180 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 10893 microversion: 2.20 time: 0.146310 Dec 15 16:08:32.321193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 122/255] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:32 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 10893 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:32.348219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:32.361170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-afc81250-eacc-4ff4-b6f4-8d46a5ec7c04 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.471523 Dec 15 16:08:32.361792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 134/256] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:31 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:32.503035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:32.504064 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:32.514952 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.515591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.516485 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.517008 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.591994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-b30b1753-4d02-4e04-accd-fd078f62e205 req-f5049fad-1a32-4732-b1d7-fe38dbfbf526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5577c9-2665-43bb-ac9a-d04e41ef7b08", "tag": "35ce0a65-53c3-47e1-b932-52d9637579b7"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:32.594793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:32.594793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:32.608090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-b30b1753-4d02-4e04-accd-fd078f62e205 req-f5049fad-1a32-4732-b1d7-fe38dbfbf526 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.608755 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-b30b1753-4d02-4e04-accd-fd078f62e205 req-f5049fad-1a32-4732-b1d7-fe38dbfbf526 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.617074 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9f155a19-18d1-4ffe-9e8b-98a38a3ba9e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.121087 Dec 15 16:08:32.617712 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 123/257] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:32 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:32.624426 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-b30b1753-4d02-4e04-accd-fd078f62e205 req-f5049fad-1a32-4732-b1d7-fe38dbfbf526 service nova] Creating event network-changed:35ce0a65-53c3-47e1-b932-52d9637579b7 for instance 7b5577c9-2665-43bb-ac9a-d04e41ef7b08 on hv-cinder-80070 Dec 15 16:08:32.629739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-b30b1753-4d02-4e04-accd-fd078f62e205 req-f5049fad-1a32-4732-b1d7-fe38dbfbf526 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041324 Dec 15 16:08:32.631062 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 135/258] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:32.734301 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:32.735576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:32.758662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.759111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.760131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.760568 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.940322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:32.940897 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:32.955554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.955982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:32.961092 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:32.961893 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.017319 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] HTTP exception thrown: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. Dec 15 16:08:33.026110 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Returning 404 to user: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:33.027290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-33073776-8ce4-4f38-be41-2868ddd041b5 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "DELETE /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 404 len: 111 microversion: 2.1 time: 0.091341 Dec 15 16:08:33.030207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 136/259] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:08:32 2021] DELETE /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:33.042744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:33.044614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] [instance: 771cf51f-79f3-4a84-8ebc-a9497a016143] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:33.062784 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.063224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.064030 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.064463 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.115480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] HTTP exception thrown: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. Dec 15 16:08:33.116270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] Returning 404 to user: Instance 771cf51f-79f3-4a84-8ebc-a9497a016143 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:33.117503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-991ce1f7-024c-42c8-bb9c-3b7dada9b734 tempest-DeleteServersTestJSON-1749512201 tempest-DeleteServersTestJSON-1749512201-project] 10.222.0.41 "GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143" status: 404 len: 111 microversion: 2.1 time: 0.084078 Dec 15 16:08:33.118670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 137/260] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:33 2021] GET /compute/v2.1/servers/771cf51f-79f3-4a84-8ebc-a9497a016143 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:08:33.188690 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:33.189027 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:33.200122 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.200566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.201402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.202423 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.620434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:33.637221 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-924a173f-a2c0-41ce-bfef-e3dde7313ee6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.913189 Dec 15 16:08:33.638383 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 124/261] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:32 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:33.658452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:33.659801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:33.676570 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.685599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.686988 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.687771 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.813858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-42519a4c-10c0-4b02-9940-9adbad471068 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 15110 microversion: 2.20 time: 0.173667 Dec 15 16:08:33.816149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 125/262] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:33 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 15110 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:33.825781 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:33.826910 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:33.848621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.849232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:33.850374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:33.851016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.068106 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:34.076244 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-482ada64-5e9c-4e7e-a4d7-5102ab367882 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1507 microversion: 2.1 time: 0.892196 Dec 15 16:08:34.091209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 138/263] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:33 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1507 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:34.103135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:34.104448 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:34.120705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.121204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.122080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.122616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.258728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-65152e6e-435e-451b-9462-30c0db927a63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 14 microversion: 2.1 time: 0.165770 Dec 15 16:08:34.266560 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 139/264] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:34 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:34.289201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88b529a4-e356-4e5b-9080-5a385be851a2"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:34.290456 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:34.311955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.312853 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.313882 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.314534 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.507920 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] HTTP exception thrown: Invalid volume: volume 88b529a4-e356-4e5b-9080-5a385be851a2 is already attached to instances: 90132a29-e694-4b33-b9c1-3be0e2555008 Dec 15 16:08:34.508765 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Returning 400 to user: Invalid volume: volume 88b529a4-e356-4e5b-9080-5a385be851a2 is already attached to instances: 90132a29-e694-4b33-b9c1-3be0e2555008 {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:34.511683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1554ad14-a25d-44b6-acb5-4218c4453fd4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.242480 Dec 15 16:08:34.512884 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 140/265] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:08:34 2021] POST /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2/os-volume_attachments => generated 174 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:08:34.594764 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:34.609647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b9edd5d2-5272-4b8d-bf66-312de489eea5 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.787243 Dec 15 16:08:34.609647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 126/266] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:33 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:34.627373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:34.627935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:34.641955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.646906 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.647990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.648936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.656145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:34.657412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:34.668266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.669299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.672888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:34.673562 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:34.864941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lazy-loading 'services' on Instance uuid 90132a29-e694-4b33-b9c1-3be0e2555008 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:08:35.039936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f482cd7f-2e3f-41d4-9ee8-963389ece335 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments/88b529a4-e356-4e5b-9080-5a385be851a2" status: 202 len: 0 microversion: 2.1 time: 0.420232 Dec 15 16:08:35.040424 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 141/267] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:08:34 2021] DELETE /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments/88b529a4-e356-4e5b-9080-5a385be851a2 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:35.047061 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:35.048114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:35.062829 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.063627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.064584 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.065172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.203818 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-91606d0b-c6f1-4c35-a66c-ef2f59b5de55 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 18030 microversion: 2.20 time: 0.158909 Dec 15 16:08:35.205148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 142/268] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:35 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 18030 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:35.207154 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:35.212873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:35.214271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:35.219439 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-54a8e114-1b03-4f51-9d18-407a7d98505b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.566891 Dec 15 16:08:35.223560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 127/269] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:34 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:35.231293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.232777 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.233821 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.234522 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.269350 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:35.270373 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:35.283401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.284143 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.285859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.286474 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.326252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-efea3eee-e998-4b58-89be-edf80d072ec7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119519 Dec 15 16:08:35.335914 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 143/270] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:08:35 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:35.412077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-667f5751-cc46-4240-8728-44d700c8fa44 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 6139 microversion: 2.1 time: 0.146063 Dec 15 16:08:35.413006 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 128/271] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:35 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 6139 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:35.627529 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:35.628694 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:35.643721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.644980 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:35.647971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:35.650370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.158316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:36.169409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7284e5aa-fd0b-4851-b7c9-8f92204aea66 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.547540 Dec 15 16:08:36.174606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 144/272] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:35 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:36.218347 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:36.219969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:36.235774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.236457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.237426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.238018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.241832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:36.244788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:36.254522 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.255337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.256283 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.256862 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.371201 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5c121e3a-dfdb-4e43-98b7-2150a91d8663 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 19342 microversion: 2.20 time: 0.159072 Dec 15 16:08:36.377590 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 129/273] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:36 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 19342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:36.390752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:36.390752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:36.412308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.413227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.414444 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.415060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.466709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6baa776c-4732-4cff-93b5-5966fcf1936f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089305 Dec 15 16:08:36.471798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 130/274] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:08:36 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:36.482281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:36.484070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:36.506030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.506507 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.507359 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:36.507790 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:36.597575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f072d2f8-655f-4355-ad90-1248750e91b9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 10894 microversion: 2.1 time: 0.123971 Dec 15 16:08:36.601420 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 131/275] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:36 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 10894 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:36.663512 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:36.682003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5336c490-7125-4598-a179-7c7b5175d02d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.446358 Dec 15 16:08:36.687904 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 145/276] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:36 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:37.191479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:37.192483 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:37.214888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.215323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.227251 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.229420 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.385453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:37.386471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:37.395123 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.395576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.401319 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.402820 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.534627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1361c2ca-7565-4576-a579-42d2a8300612 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 21288 microversion: 2.20 time: 0.152928 Dec 15 16:08:37.535769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 146/277] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:37 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 21288 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:37.541091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:37.547228 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:37.561444 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.562409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.566605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.568239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.645988 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:37.655381 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7eebcd5f-0702-4f6c-ac86-757be01db624 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.472101 Dec 15 16:08:37.656973 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5a91c133-3cf3-4fdb-9f9a-b3dc3cda329d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119830 Dec 15 16:08:37.657573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 147/278] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:08:37 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:08:37.662744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 132/279] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:37 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:37.671086 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:37.672017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:37.694966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.695420 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.697295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.701366 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.707163 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:37.708106 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:37.716535 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.721542 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.722666 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:37.723331 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:37.809319 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6473b989-6108-4567-a330-87b132ce5110 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 16319 microversion: 2.1 time: 0.149601 Dec 15 16:08:37.813925 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 148/280] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:37 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 16319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:38.021388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:38.030479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b7ab43c8-c20d-4b36-9d9d-73af2b0b68c6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.328014 Dec 15 16:08:38.033335 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 133/281] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:37 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:38.039190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1938678865", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "759c34f4-14be-417a-897c-06d30e0fd249"}]}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:38.122594 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] validate_networks() for [('759c34f4-14be-417a-897c-06d30e0fd249', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:08:38.184458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2d41321b-16f3-47ba-bf77-087a79a86747 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Action: 'create', calling method: .version_select at 0x7f0514cc8550>, body: {"keypair": {"name": "tempest-TestShelveInstance-693928270"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:38.217264 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-2d41321b-16f3-47ba-bf77-087a79a86747 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Getting quotas for project 79292acd0f5349ed8f0dc153ee4c983d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:08:38.227797 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-2d41321b-16f3-47ba-bf77-087a79a86747 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Getting quotas for user 167f076ea79547b6b93b25b80d24330a and project 79292acd0f5349ed8f0dc153ee4c983d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:08:38.605509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-2d41321b-16f3-47ba-bf77-087a79a86747 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Getting quotas for project 79292acd0f5349ed8f0dc153ee4c983d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:08:38.618531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-2d41321b-16f3-47ba-bf77-087a79a86747 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Getting quotas for user 167f076ea79547b6b93b25b80d24330a and project 79292acd0f5349ed8f0dc153ee4c983d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:08:38.656005 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2d41321b-16f3-47ba-bf77-087a79a86747 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.836881 Dec 15 16:08:38.675720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 149/282] 10.222.0.41 () {60 vars in 1157 bytes} [Wed Dec 15 16:08:37 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:38.694281 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:38.695262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:38.724975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.725441 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.730474 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.730917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.902655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:08:38.903694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:08:38.904915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:08:38.905525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:08:38.906077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:08:38.924035 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-333426d8-d282-4a6f-82ab-19233ce983e7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 23180 microversion: 2.20 time: 0.246959 Dec 15 16:08:38.927903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 150/283] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:38 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 23180 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:38.930018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.934787 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:38.935458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:38.940677 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.941586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.942017 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.953251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.954014 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:38.954301 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:38.954800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:39.005079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:08:39.009205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for user 50f2f5e4390046308cce9ef7ab394abd and project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:08:39.030125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:08:39.032485 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:08:39.125020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-acaedbcd-6367-489f-9a65-28afc48e099d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.089225 Dec 15 16:08:39.126011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 134/284] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:08:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:08:39.138216 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:39.155739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:39.173165 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:39.175447 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:39.177382 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:39.179700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:39.329378 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2a08f29b-e649-467d-a70f-bb9674fa99fc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 18356 microversion: 2.1 time: 0.195385 Dec 15 16:08:39.330091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 135/285] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:39 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 18356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:39.349804 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:39.355669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:39.379613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:39.380166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:39.381021 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:39.381458 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:39.532847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:39.546857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2218a522-1c3a-43f7-a1e1-a195f50123d2 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.620793 Dec 15 16:08:39.558428 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 151/286] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:38 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:39.568855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-34e6ce24-27fa-47b5-89b1-101fbfdcd7fc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:39.569880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-34e6ce24-27fa-47b5-89b1-101fbfdcd7fc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:39.677572 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-34e6ce24-27fa-47b5-89b1-101fbfdcd7fc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:39.689031 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-34e6ce24-27fa-47b5-89b1-101fbfdcd7fc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1218 microversion: 2.1 time: 0.128856 Dec 15 16:08:39.690484 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 152/287] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:39 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:39.793267 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:39.802906 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e0b38ea1-69e6-4f5e-9f67-dbcb0454c57a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.470645 Dec 15 16:08:39.806439 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 136/288] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:39 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:39.934835 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:39.935845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:39.953284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:39.953720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:39.955839 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:39.957481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.090009 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-23e8c9a4-3360-4401-ba63-639f065aa493 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 24254 microversion: 2.20 time: 0.158566 Dec 15 16:08:40.091038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 153/289] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:39 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 24254 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:40.343648 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:40.345565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:40.361440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.363855 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.366476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.370569 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.520678 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d822980e-527a-4bdf-8f1a-60ae215637f6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 20593 microversion: 2.1 time: 0.181123 Dec 15 16:08:40.521769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 137/290] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:40 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 20593 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:40.572636 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:40.573679 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:40.593908 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.595358 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.596435 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.597961 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.712194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:40.713327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:40.721744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.722916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.724555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.725369 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.864692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:40.877568 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6e9feeb8-c61b-45fd-8627-7fd92353d392 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1270 microversion: 2.1 time: 0.174788 Dec 15 16:08:40.878327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 138/291] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:40 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:40.887809 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:40.888480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:40.917205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.917890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.920980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:40.921749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:40.951508 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:40.963606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6c5487c2-180a-49f7-8f8b-6edc7830e620 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.402998 Dec 15 16:08:40.968608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 154/292] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:40 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:41.110715 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:41.112028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:41.123810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:41.124270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:41.125081 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:41.125514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:41.290868 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0d0d316e-75f5-4b97-b31c-2bbdea80b8de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 25138 microversion: 2.20 time: 0.190101 Dec 15 16:08:41.297039 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 155/293] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:41 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 25138 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:41.538857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:41.540190 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:41.569812 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:41.570900 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:41.573883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:41.575436 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:41.727117 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4ba919ac-63c1-4849-8ef5-d188b5aa8786 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 22168 microversion: 2.1 time: 0.196421 Dec 15 16:08:41.728466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 156/294] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:41 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 22168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:41.769735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:41.796163 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-61c27b55-6986-4e73-b127-65d51d252d4b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.912367 Dec 15 16:08:41.807926 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 139/295] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:40 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:41.905130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:41.907266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:41.919478 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:41.920659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:41.921646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:41.923089 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:41.984523 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:41.985323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:41.999170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.000223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.001307 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.003143 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.208659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:42.221279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cde4439f-c4b6-4de5-b65a-9258156527e3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1276 microversion: 2.1 time: 0.328040 Dec 15 16:08:42.223141 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 157/296] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:41 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:42.305889 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:42.307234 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:42.320846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.321299 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.322583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.323063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.449648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b7ec5216-0af1-4a0a-9e56-d088d1f829e6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 26150 microversion: 2.20 time: 0.147966 Dec 15 16:08:42.455223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 158/297] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:42 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 26150 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:08:42.706005 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:42.718316 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fc32119b-ec96-4ab0-8c3a-7ce7b2c840d9 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.741172 Dec 15 16:08:42.729475 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 140/298] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:41 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:42.740346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:42.741405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:42.750781 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.752988 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.754005 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.754699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.816559 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:42.817775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:42.831688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.832499 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.833750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:42.834714 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:42.901958 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-445778f6-2732-47d3-99c4-367d7abce539 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 23804 microversion: 2.1 time: 0.165753 Dec 15 16:08:42.910221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 159/299] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:42 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 23804 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:43.057450 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:43.072962 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e8df78e7-1cbd-4bcb-b4e7-adc11e366f34 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.263943 Dec 15 16:08:43.085325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 141/300] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:42 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:43.242886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:43.243706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:43.252886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.253254 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.254048 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.254524 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.460857 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:43.461540 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:43.480040 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.480693 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.481623 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.482260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.536042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:43.546949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e851c515-caa0-4c22-9594-00b4a0350692 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.310419 Dec 15 16:08:43.558583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 160/301] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:43 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:43.632081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4f779f4e-b046-4ec5-957a-b08c0e3647d6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 26808 microversion: 2.20 time: 0.174868 Dec 15 16:08:43.633076 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 142/302] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:43 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 26808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:08:43.735841 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:43.736517 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:43.751260 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.752165 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.754713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.755376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.916266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:43.917500 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:43.931100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.931777 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:43.933641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:43.934083 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.063242 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c7bb4b1f-5fbf-4eec-ae8d-fd5c7da3292e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 24637 microversion: 2.1 time: 0.151123 Dec 15 16:08:44.070691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 143/303] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:43 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 24637 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:44.079040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:44.092110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:44.092807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:44.099116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7732712b-b518-4848-95ef-006b855f9d3c tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.367022 Dec 15 16:08:44.109890 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 161/304] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:43 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:44.110145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.110145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.110145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.110145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.373602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-97604ffc-13d2-49b1-8605-c1cba59ba1f1 req-47ece032-67b8-4788-86b7-1922138e2525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5577c9-2665-43bb-ac9a-d04e41ef7b08", "name": "network-vif-plugged", "status": "completed", "tag": "35ce0a65-53c3-47e1-b932-52d9637579b7"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:44.376208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:44.376208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:08:44.387909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-97604ffc-13d2-49b1-8605-c1cba59ba1f1 req-47ece032-67b8-4788-86b7-1922138e2525 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.388664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-97604ffc-13d2-49b1-8605-c1cba59ba1f1 req-47ece032-67b8-4788-86b7-1922138e2525 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.408994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-97604ffc-13d2-49b1-8605-c1cba59ba1f1 req-47ece032-67b8-4788-86b7-1922138e2525 service nova] Creating event network-vif-plugged:35ce0a65-53c3-47e1-b932-52d9637579b7 for instance 7b5577c9-2665-43bb-ac9a-d04e41ef7b08 on hv-cinder-80070 Dec 15 16:08:44.417584 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-97604ffc-13d2-49b1-8605-c1cba59ba1f1 req-47ece032-67b8-4788-86b7-1922138e2525 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048894 Dec 15 16:08:44.418984 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 162/305] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:44.570888 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:44.571961 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:44.581792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.585370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.587281 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.588646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.659995 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:44.695687 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8cb05fd0-5250-492a-86db-c497a8875956 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.607680 Dec 15 16:08:44.712036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 144/306] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:44 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:44.718881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:44.720095 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:44.726770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.727587 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.728616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:44.729264 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:44.839612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b5330e2d-999b-45a1-85c6-edaeab1f668e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 27223 microversion: 2.20 time: 0.125463 Dec 15 16:08:44.839941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:44.840743 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 145/307] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:44 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 27223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:44.853163 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f645536a-3e31-4728-91b3-b8ada7626da8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.285542 Dec 15 16:08:44.856421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 163/308] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:44 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:45.081740 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:45.082870 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:45.104198 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.106915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.108471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.118119 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:45.119037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:45.124043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.129991 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.130470 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.131257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.137791 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.260734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3c5c080d-a3eb-49f5-b5c3-45be9b86a118 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 25652 microversion: 2.1 time: 0.183754 Dec 15 16:08:45.262196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 146/309] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:45 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 25652 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:45.287589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-88d085a1-d207-4223-95c4-21da9857dee8 req-770667d4-72e5-4509-91d9-c6c8830d5085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66", "tag": "7ef3b7cf-db50-4eb4-95cc-9057ace1fddd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:45.289497 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:45.289497 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:45.313788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-88d085a1-d207-4223-95c4-21da9857dee8 req-770667d4-72e5-4509-91d9-c6c8830d5085 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.314371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-88d085a1-d207-4223-95c4-21da9857dee8 req-770667d4-72e5-4509-91d9-c6c8830d5085 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.352899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-88d085a1-d207-4223-95c4-21da9857dee8 req-770667d4-72e5-4509-91d9-c6c8830d5085 service nova] Creating event network-changed:7ef3b7cf-db50-4eb4-95cc-9057ace1fddd for instance c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 on hv-cinder-80070 Dec 15 16:08:45.367295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-88d085a1-d207-4223-95c4-21da9857dee8 req-770667d4-72e5-4509-91d9-c6c8830d5085 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088202 Dec 15 16:08:45.368391 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 147/310] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:45.432971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:45.451387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5a2e5ebc-d715-4db1-a52b-72d5908a6ed0 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.337078 Dec 15 16:08:45.453141 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 164/311] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:45 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:45.736479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:45.738516 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:45.751862 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.752616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.754032 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.754782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.851597 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:45.852506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:45.860494 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.860712 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.861461 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:45.861893 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:45.988172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ae5c2158-8020-422b-b09f-fea903754c70 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 27460 microversion: 2.20 time: 0.139482 Dec 15 16:08:45.988401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 165/312] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:45 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 27460 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:45.994300 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:45.994979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:46.002082 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:46.003825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:46.005042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:46.005643 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:46.487618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:46.499741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-16cda952-45c7-4f94-98bd-573d5d877428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.510085 Dec 15 16:08:46.501320 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 166/313] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:45 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:46.503749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:46.513325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:46.514470 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:46.516467 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f064c6e2-874d-4ec3-bac8-956d1ffb6e18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.791038 Dec 15 16:08:46.518405 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 148/314] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:45 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:46.529817 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:46.530740 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:46.537029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:46.537478 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:46.538438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:46.538861 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:46.538998 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:46.539501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:46.541205 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:46.544502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:46.667462 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a3c15ea1-6d9b-4104-932f-a805091c7ae2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 26387 microversion: 2.1 time: 0.163513 Dec 15 16:08:46.668752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 167/315] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:46 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 26387 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:46.925922 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:46.936530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cdbbc92f-3729-4327-842b-4441b7e2babe tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1314 microversion: 2.1 time: 0.415764 Dec 15 16:08:46.937403 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 149/316] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:46 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:47.003221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:47.004473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:47.018772 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.019519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.020615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.023084 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.160405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-901d83e8-049d-47cc-9284-f229d8dfd755 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 27612 microversion: 2.20 time: 0.162534 Dec 15 16:08:47.164583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 168/317] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:46 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 27612 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:47.526840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:47.538010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:47.540759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:47.541857 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:47.555112 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.564532 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.572335 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.572798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.575091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.576158 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.576752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.577369 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.901184 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:47.914289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-794c2eab-a025-4445-a1b2-6442a6b325d5 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.400594 Dec 15 16:08:47.915036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 150/318] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:47 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:47.920286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:47.929632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:47.933436 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:47.939788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-baafd5a4-a512-4b46-94e6-88479381c12d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.408472 Dec 15 16:08:47.940338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.940944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 169/319] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:47 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:47.951272 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.952482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.953088 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.956052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:47.956667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:47.973407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.974872 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:47.978213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:47.978736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:48.079635 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-45792ef3-85fe-4272-a5fb-2ab8dd9a3f8a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 27085 microversion: 2.1 time: 0.160267 Dec 15 16:08:48.080640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 151/320] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:47 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 27085 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:48.173709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:48.175522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:48.187160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:48.188362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:48.190324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:48.191066 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:48.240399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:48.248810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bfdbe7a1-4c6b-4cf6-8b73-968cd1160d4d tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1498 microversion: 2.1 time: 0.298553 Dec 15 16:08:48.252310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 170/321] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:47 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1498 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:48.358662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-020190ac-d697-471b-8339-ba7897a1824a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 27876 microversion: 2.20 time: 0.189762 Dec 15 16:08:48.359376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 152/322] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:48 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 27876 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:08:48.932840 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:48.933443 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:48.946612 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:48.948727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:48.958851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:48.960123 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:48.967835 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:48.968563 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:48.981253 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:48.981701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:48.984416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:48.985935 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.336893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:49.349177 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c23e7716-4ac8-4bba-9088-a76a8055da40 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.395313 Dec 15 16:08:49.350485 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 153/323] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:48 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:49.356853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:49.359207 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:49.367151 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.368465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.370047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.370777 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.432328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:49.455613 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5ad572d1-169e-48ad-a6f6-0061708c8d1f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.526967 Dec 15 16:08:49.456191 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 171/324] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:48 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:49.473547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:49.474708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:49.478123 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c397b424-9818-4581-895d-02c269d4e8d2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 27611 microversion: 2.1 time: 0.125372 Dec 15 16:08:49.478881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 154/325] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:49 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 27611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:49.484246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.484989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.486133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.486889 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:49.487285 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.489628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:49.504847 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.507627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.508680 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.509928 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.517964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:08:49.669205 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-96810c91-a730-4eab-9929-1e9e7aa63dd1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 204 len: 0 microversion: 2.1 time: 0.199720 Dec 15 16:08:49.670837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 172/326] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:08:49 2021] DELETE /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:08:49.690067 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:49.691216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:49.695077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d9cade4a-ee97-48e4-bc1a-556230b9d2d5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28171 microversion: 2.20 time: 0.213730 Dec 15 16:08:49.696690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 155/327] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:49 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28171 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:49.698291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.699340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:49.700186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:49.701841 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.054864 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:50.071486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-eb173930-78b6-4158-bf10-56f60ff6149f tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1504 microversion: 2.1 time: 0.389417 Dec 15 16:08:50.072344 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 173/328] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:49 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:50.368754 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:50.370297 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:50.390126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.390621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.391444 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.392028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.473332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:50.474221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:50.480799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.481471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.482557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.483139 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.625456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:50.637952 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7acc51b2-8901-4b10-86d6-0aa5871c64e0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.274360 Dec 15 16:08:50.639659 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 156/329] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:50 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:50.645666 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:50.647483 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:50.654255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.655608 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.656806 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.657536 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.763716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:50.769798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-17547d4e-1f20-4360-80ae-c06633481d7d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 27839 microversion: 2.1 time: 0.129104 Dec 15 16:08:50.770823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 157/330] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:50 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 27839 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:50.775387 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:50.775532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f7f60078-f445-46e5-a179-8f55248fe49d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.306207 Dec 15 16:08:50.776375 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:50.783208 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.783870 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.784872 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:50.785494 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:50.786529 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 174/331] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:50 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:50.890061 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ea95f20d-105c-4f64-92c4-16329cba6af9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28171 microversion: 2.20 time: 0.117843 Dec 15 16:08:50.890942 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 158/332] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:50 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28171 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:51.089100 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:51.090909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:51.117339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.117907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.118752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.119365 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.299365 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:51.307267 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a10157f1-23ff-4137-82f1-845dc1a5ce15 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1504 microversion: 2.1 time: 0.222327 Dec 15 16:08:51.312655 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 175/333] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:51 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:51.656875 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:51.658383 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:51.665304 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.665837 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.667151 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.667665 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.785114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:51.796270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:51.814697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.817050 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.818845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.820941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.925134 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:51.937052 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-239ccbcd-3e19-467d-95bf-568a39b185f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.284513 Dec 15 16:08:51.938955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 159/334] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:51 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:51.955762 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:51.956725 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:51.967293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9fb5f0a6-545d-43df-95f2-d7739c976b9f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28044 microversion: 2.1 time: 0.189165 Dec 15 16:08:51.967938 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 176/335] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:51 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28044 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:51.975785 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.978371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.979965 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:51.980581 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:51.990266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:51.998900 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:52.019416 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.023658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.027993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.031374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.153618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d2416b95-4f40-40a7-82ea-d31630f7a8fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28171 microversion: 2.20 time: 0.183809 Dec 15 16:08:52.155028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 177/336] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:51 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28171 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:52.295474 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:52.304859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3bd30bb8-9f59-4d64-958c-98601ab6b417 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.362928 Dec 15 16:08:52.306192 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 160/337] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:51 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:52.331280 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:52.332475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:52.378791 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.379240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.380034 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.380516 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.686115 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:52.698894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-efbe49c3-2cba-4b9e-afa8-3cb528901961 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1504 microversion: 2.1 time: 0.374116 Dec 15 16:08:52.699878 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 178/338] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:52 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:52.923420 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-fcf93c1a-58d2-49ba-9067-afd20ebc6268 req-37f4c00b-8de3-40ce-aca8-a2a28fe5b462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5577c9-2665-43bb-ac9a-d04e41ef7b08", "name": "network-vif-deleted", "tag": "35ce0a65-53c3-47e1-b932-52d9637579b7"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:52.925325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:52.925325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:52.941918 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-fcf93c1a-58d2-49ba-9067-afd20ebc6268 req-37f4c00b-8de3-40ce-aca8-a2a28fe5b462 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.944157 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-fcf93c1a-58d2-49ba-9067-afd20ebc6268 req-37f4c00b-8de3-40ce-aca8-a2a28fe5b462 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:52.955172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:52.955929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:52.971192 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-fcf93c1a-58d2-49ba-9067-afd20ebc6268 req-37f4c00b-8de3-40ce-aca8-a2a28fe5b462 service nova] Creating event network-vif-deleted:35ce0a65-53c3-47e1-b932-52d9637579b7 for instance 7b5577c9-2665-43bb-ac9a-d04e41ef7b08 on hv-cinder-80070 Dec 15 16:08:52.998912 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:52.999521 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.000370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.000807 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.001386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-fcf93c1a-58d2-49ba-9067-afd20ebc6268 req-37f4c00b-8de3-40ce-aca8-a2a28fe5b462 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080047 Dec 15 16:08:53.003419 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 161/339] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:08:53.028658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:53.030304 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:53.059375 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.061857 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.066457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.068868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.216734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a37d863e-68e0-4147-8cc4-8b14cc333fc9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28187 microversion: 2.1 time: 0.208676 Dec 15 16:08:53.217388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 162/340] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:53 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28187 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:53.226430 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:53.227459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:53.244263 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.244969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.245799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.246277 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.314143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:53.342856 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e8caa513-61f3-4cad-b45a-788d2f6105ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.391555 Dec 15 16:08:53.344186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 179/341] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:52 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:53.351712 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:53.353970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:53.365735 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.366608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.367831 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.370738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.433204 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bb38f05f-3b03-4d5e-b3c6-e446035c5784 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28362 microversion: 2.20 time: 0.214432 Dec 15 16:08:53.434710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 163/342] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:53 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:53.592847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:53.617361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b9593eea-48b5-4768-9bc4-c6a6a6175737 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.271605 Dec 15 16:08:53.627915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 180/343] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:53 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:53.718112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:53.720470 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:53.727353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.728086 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.729089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.729733 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.777769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:53.778606 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:53.782246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lazy-loading 'fault' on Instance uuid 7b5577c9-2665-43bb-ac9a-d04e41ef7b08 {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:08:53.842949 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53797e5970544aeababe0d0ecbf68114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a663ffafde40436f8ebccd5f5dea55f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:53.853464 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-eec878f0-62d7-4ad0-87bf-4090b2af1f1b tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 200 len: 1304 microversion: 2.1 time: 0.140095 Dec 15 16:08:53.860069 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 164/344] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:53 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:54.234368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:54.235722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:54.243971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.244830 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.245849 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.246536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.360671 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:54.362835 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:54.375912 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e79e6fcf-ffb7-46ce-861b-e4de344151ef tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28187 microversion: 2.1 time: 0.146995 Dec 15 16:08:54.378107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 181/345] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:54 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:54.384384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.385045 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.386010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.386614 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.449287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:54.450333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:54.461623 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.465181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.466360 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.467504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.586431 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-904f2361-dd15-4fec-a916-fd875e5a8f69 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28458 microversion: 2.20 time: 0.144221 Dec 15 16:08:54.591608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 182/346] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:54 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:08:54.640396 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:54.649476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-433e2cd0-b1e2-49b2-b2a5-1ad99e35fc08 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.293841 Dec 15 16:08:54.653058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:54.655402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:54.657094 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 165/347] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:54 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:08:54.684525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.685003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.687907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.695701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.877690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:54.878238 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] [instance: 7b5577c9-2665-43bb-ac9a-d04e41ef7b08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:54.886283 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.886647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.887442 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:54.888822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:54.954654 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] HTTP exception thrown: Instance 7b5577c9-2665-43bb-ac9a-d04e41ef7b08 could not be found. Dec 15 16:08:54.955697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] Returning 404 to user: Instance 7b5577c9-2665-43bb-ac9a-d04e41ef7b08 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:08:54.958628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ce4f7b96-59d2-4abd-a8ed-bc832cd766d1 tempest-VolumesActionsTest-83087386 tempest-VolumesActionsTest-83087386-project] 10.222.0.41 "GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08" status: 404 len: 111 microversion: 2.1 time: 0.083514 Dec 15 16:08:54.959528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 166/348] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:54 2021] GET /compute/v2.1/servers/7b5577c9-2665-43bb-ac9a-d04e41ef7b08 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:08:54.990993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:55.004736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f82613a5-24ee-4b46-b429-0589fe2bab4e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.371877 Dec 15 16:08:55.005840 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 183/349] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:54 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:55.388407 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:55.389357 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:55.399144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:55.399601 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:55.402701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:55.403380 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:55.509541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-318cea2f-4e7f-40ad-a4e3-9d05b1053b1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28187 microversion: 2.1 time: 0.124790 Dec 15 16:08:55.514390 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 167/350] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:55 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:55.599484 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:55.601601 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:55.632794 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:55.636359 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:55.637904 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:55.640373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:55.677173 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:55.678423 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:55.688702 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:55.694894 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:55.696030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:55.696633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:55.795395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3f2f133a-5330-4e3f-a087-5f14c854484c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28554 microversion: 2.20 time: 0.199264 Dec 15 16:08:55.799615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 184/351] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:55 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:55.925139 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:55.934706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4831f90d-45a0-4fb9-8c54-58321c266037 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.261647 Dec 15 16:08:55.936834 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 168/352] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:55 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:56.026130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:56.026997 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:56.045864 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.057576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.065676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.066407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.342997 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:56.362727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e30622bd-52fb-404e-95a4-106c12142613 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.340096 Dec 15 16:08:56.372865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 185/353] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:56 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:56.448782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-5dff33ff-827d-4ef8-a89a-a92dcd0cc2a6 req-6ec78350-1cc7-4df4-9c20-12955b03dce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66", "name": "network-vif-plugged", "status": "completed", "tag": "7ef3b7cf-db50-4eb4-95cc-9057ace1fddd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:56.457748 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:08:56.457748 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:08:56.485205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-5dff33ff-827d-4ef8-a89a-a92dcd0cc2a6 req-6ec78350-1cc7-4df4-9c20-12955b03dce9 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.485776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-5dff33ff-827d-4ef8-a89a-a92dcd0cc2a6 req-6ec78350-1cc7-4df4-9c20-12955b03dce9 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.512174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-5dff33ff-827d-4ef8-a89a-a92dcd0cc2a6 req-6ec78350-1cc7-4df4-9c20-12955b03dce9 service nova] Creating event network-vif-plugged:7ef3b7cf-db50-4eb4-95cc-9057ace1fddd for instance c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 on hv-cinder-80070 Dec 15 16:08:56.522218 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:56.523490 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:56.533973 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-5dff33ff-827d-4ef8-a89a-a92dcd0cc2a6 req-6ec78350-1cc7-4df4-9c20-12955b03dce9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092865 Dec 15 16:08:56.534801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 169/354] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:08:56.543255 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.563857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.565054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.565594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.707953 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a50bc151-d2f3-4e5b-a314-1251313640c5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28477 microversion: 2.1 time: 0.189684 Dec 15 16:08:56.709937 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 186/355] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:56 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:08:56.809165 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:56.810233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:56.821827 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.824652 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.826209 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.828695 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.953759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:56.954500 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:56.961936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.962280 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.963079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:56.963687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:56.969784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-53e00962-8a5a-4972-80fa-dd129665b61d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.165607 Dec 15 16:08:56.971716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 170/356] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:56 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:57.250953 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:57.273012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0a353a3f-bf5d-49dc-837a-f292dd4ef908 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.323752 Dec 15 16:08:57.273641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 187/357] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:56 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:57.382751 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:57.383729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:57.394556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:57.399365 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:57.400188 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:57.401219 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:57.622187 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:57.631584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-22a8b9c6-40e7-42f3-9e70-bd03070b6f9a tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1318 microversion: 2.1 time: 0.253726 Dec 15 16:08:57.632398 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 171/358] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:57 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:57.721890 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:57.723449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:57.729966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:57.730535 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:57.731401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:57.731971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:57.837877 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fef48f7f-24bf-478f-b5d3-2bd6b572a828 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28477 microversion: 2.1 time: 0.120915 Dec 15 16:08:57.843036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 188/359] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:57 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28477 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:08:57.985014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:57.985980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:58.005710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.006129 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.007207 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.007650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.152174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f081b465-5c27-42bf-a736-5ffc114c0464 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.171211 Dec 15 16:08:58.153751 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 172/360] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:57 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:08:58.290503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:58.291781 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:58.300316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.301275 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.302373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.302958 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.523157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:58.531358 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-df31dfa9-587b-4a41-b211-69e2ed4fe6d1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.245013 Dec 15 16:08:58.531927 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 189/361] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:58 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:58.651659 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:08:58.652373 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:58.659886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.660357 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.661574 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.662388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.830954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:08:58.840826 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ac99adea-798f-4b4f-98c8-19c27e5aa0a3 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1508 microversion: 2.1 time: 0.194353 Dec 15 16:08:58.841623 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 173/362] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:08:58 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:08:58.850967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:58.853413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:58.868610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.868610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:58.869403 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:58.873266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:59.164035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:08:59.164994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:08:59.177737 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:59.181137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:08:59.182117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:08:59.182738 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:01.560455 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3813b70c-4280-4ff1-8f15-65b52d0696e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28477 microversion: 2.1 time: 2.713343 Dec 15 16:09:01.566401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 190/363] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:08:58 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28477 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:09:01.577282 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2de80db9-e56e-4c89-bcb0-d6696981ee0b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 2.416802 Dec 15 16:09:01.579217 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 174/364] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:08:59 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 2420 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:09:01.583045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:01.585401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:01.596150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:01.596823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:01.597801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:01.598449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:01.781993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:01.790570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4785a7be-edef-484d-83df-aff570b4dd71 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.220559 Dec 15 16:09:01.791378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 191/365] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:01 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:02.519975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe45f33d-03d7-4911-b076-96bfef3b09ba"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:02.523231 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:02.539408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.540070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.541488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.542118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.573171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:02.574789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:02.585248 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.586003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.587586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.588081 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.723936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-89d1ab16-418d-4321-a864-e8c496e04215 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.154416 Dec 15 16:09:02.726358 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 192/366] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:02 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:09:02.732430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:02.736130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:02.744048 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.744788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.746605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.748056 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.892138 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-eb23c3d3-0bd5-434e-9550-8d09267aa5d9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.163243 Dec 15 16:09:02.895324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 193/367] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:02 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:02.903468 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:02.904860 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:02.912658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.913505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.915049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:02.915789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:02.988589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7a3bc8c4-578d-42a4-bfda-452eeb4726f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473053 Dec 15 16:09:02.994289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 175/368] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:09:02 2021] POST /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:09:03.168119 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:03.185767 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-87e8f77e-0b2b-4597-ba80-9e5bbfdb24ba tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.288265 Dec 15 16:09:03.186532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 194/369] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:02 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:03.743703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:03.744775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:03.761388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:03.761895 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:03.765779 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:03.766265 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:03.905886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:03.908246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:03.912851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-48e62dcf-221d-4d14-b48c-6dede994f2d6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.175459 Dec 15 16:09:03.913829 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 176/370] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:03 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:03.923922 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:03.925084 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:03.928135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:03.928867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:04.205929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:04.206785 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:04.225428 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:04.230636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:04.232299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:04.232969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:04.288273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2d020ae5-2eae-4d1c-85c5-bfd37c0a1b9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.386955 Dec 15 16:09:04.288932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 195/371] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:03 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:09:04.525227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:04.539540 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a033f4d7-703a-410e-9da9-e4513f2e3ace tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.337069 Dec 15 16:09:04.541445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 177/372] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:04 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:04.794509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cc9a65f6-269d-4a28-953c-f9b138dc65fd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Action: 'create', calling method: .version_select at 0x7f05144410d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1512623372"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:04.836810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-cc9a65f6-269d-4a28-953c-f9b138dc65fd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Getting quotas for project 3c3dc08abeae460eb69305e30b4fe62d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:09:04.857039 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-cc9a65f6-269d-4a28-953c-f9b138dc65fd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Getting quotas for user ed44a537084a4e7183cc5ca792ba5260 and project 3c3dc08abeae460eb69305e30b4fe62d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:09:04.925896 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:04.927164 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:04.939610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:04.940372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:04.942252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:04.943317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:04.974757 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-cc9a65f6-269d-4a28-953c-f9b138dc65fd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Getting quotas for project 3c3dc08abeae460eb69305e30b4fe62d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:09:04.982034 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-cc9a65f6-269d-4a28-953c-f9b138dc65fd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Getting quotas for user ed44a537084a4e7183cc5ca792ba5260 and project 3c3dc08abeae460eb69305e30b4fe62d. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:09:05.000826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cc9a65f6-269d-4a28-953c-f9b138dc65fd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.211417 Dec 15 16:09:05.001858 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 196/373] 10.222.0.41 () {60 vars in 1157 bytes} [Wed Dec 15 16:09:04 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:05.050631 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-acf91a1b-f83d-446a-9870-e7283e271c4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.128200 Dec 15 16:09:05.052399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 178/374] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:04 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:05.143659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1625054771", "imageRef": "bbf95d0b-5e1e-49f8-8cf0-5a5a84d934e1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1512623372", "networks": [{"uuid": "8c6a9796-65fb-4c77-a7bf-f3674189738c"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:05.208933 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] validate_networks() for [('8c6a9796-65fb-4c77-a7bf-f3674189738c', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:09:05.309248 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:05.310300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:05.326195 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:05.327771 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:05.329898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:05.331202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:05.427126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-34dfba7d-5576-46bb-bba8-faf00c5bd2fa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.125958 Dec 15 16:09:05.432719 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 179/375] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:05 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:05.563232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:05.564324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:05.583190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:05.583907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:05.586786 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:05.588893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:05.723796 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:09:05.724428 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:09:05.724946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:09:05.725396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:09:05.725845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:09:05.737702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:05.738459 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:05.739325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:05.740121 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:05.763485 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Getting quotas for project 3c3dc08abeae460eb69305e30b4fe62d. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:09:05.770410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Getting quotas for user ed44a537084a4e7183cc5ca792ba5260 and project 3c3dc08abeae460eb69305e30b4fe62d. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:09:05.788628 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:09:05.792984 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbf95d0b-5e1e-49f8-8cf0-5a5a84d934e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:09:05.906455 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-282eb4f7-1160-407f-a10e-39538da17f14 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766722 Dec 15 16:09:05.913719 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 197/376] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:09:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:09:05.920058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a3d92add-56f7-4a35-b272-7be8d6fd5e98 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:05.921060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a3d92add-56f7-4a35-b272-7be8d6fd5e98 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:05.968907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:05.979758 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-36dcd206-a5a4-431a-be07-10a30aaba0e1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1521 microversion: 2.1 time: 0.422763 Dec 15 16:09:05.983112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 180/377] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:05 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:06.000653 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a3d92add-56f7-4a35-b272-7be8d6fd5e98 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:06.008617 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a3d92add-56f7-4a35-b272-7be8d6fd5e98 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1259 microversion: 2.1 time: 0.093559 Dec 15 16:09:06.009366 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 198/378] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:05 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1259 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:06.066044 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:06.067435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:06.082060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:06.082565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:06.083385 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:06.086955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:06.223011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d1fd4617-5e09-4954-b3de-65fd97aaf752 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.162079 Dec 15 16:09:06.228344 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 181/379] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:06 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:06.441576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:06.443032 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:06.456422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:06.457656 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:06.458964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:06.460026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:06.581994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ee20961e-5f54-469a-9e77-444f037f2e95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.144817 Dec 15 16:09:06.582971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 199/380] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:06 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:09:07.000123 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:07.000888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:07.011351 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.014870 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.016052 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.016736 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.027774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:07.029881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:07.044707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.050305 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.051438 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.052131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.147815 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:07.156186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-844c032d-6927-4fe7-acc8-8f66b3f24959 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1311 microversion: 2.1 time: 0.133395 Dec 15 16:09:07.157323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 200/381] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:07 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:07.254254 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:07.255580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:07.268593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.269043 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.269837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.270506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.303175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:07.319834 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b4213ece-4395-4db6-8d68-08dbb9ea7f15 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1501 microversion: 2.1 time: 0.321726 Dec 15 16:09:07.323355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 182/382] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:06 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1501 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:07.342807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:07.344137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:07.354200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.355024 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.355953 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.357030 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.465144 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bc083a4f-0e7b-499a-a32a-c819fa01a767 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.227035 Dec 15 16:09:07.466975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 201/383] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:07 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:07.595654 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:07.610184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:07.629626 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.635953 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.636991 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:07.637609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:07.703817 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:07.713505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-082e1a13-1d94-4294-9e07-9a71124f8645 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1516 microversion: 2.1 time: 0.375870 Dec 15 16:09:07.724139 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 183/384] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:07 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1516 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:07.758045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-67e50395-2aa9-4e8f-9a17-86f0c1eeffef tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28625 microversion: 2.20 time: 0.166733 Dec 15 16:09:07.761874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 202/385] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:07 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28625 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:09:08.173419 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:08.173957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:08.201310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:08.204663 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:08.209379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:08.210760 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:08.377452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:08.413364 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-528730dd-98cd-458b-ba1c-7de3e73445cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1317 microversion: 2.1 time: 0.242866 Dec 15 16:09:08.415010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 184/386] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:08 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:08.483985 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:08.488206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:08.509564 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:08.512550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:08.514020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:08.518125 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:08.771026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fd60a018-caf7-4256-bc8a-8e0225553111 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.292391 Dec 15 16:09:08.771685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 203/387] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:08 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:08.778672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:08.782728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:08.815243 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:08.818196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:08.819391 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:08.822278 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:08.823460 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2075633469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-693928270", "security_groups": [{"name": "tempest-secgroup-smoke-1396900628"}], "networks": [{"uuid": "4579f1c5-7fc5-4782-9d02-20f1a37f593e"}], "block_device_mapping_v2": [{"uuid": "d721d243-be0a-4253-bc0e-c296862c0341", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:09.046720 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3bbc63bf-8bd1-4acf-8e4b-93cc261ece0f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 28972 microversion: 2.20 time: 0.274438 Dec 15 16:09:09.049910 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 185/388] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:08 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 28972 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:09.125782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] validate_networks() for [('4579f1c5-7fc5-4782-9d02-20f1a37f593e', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:09:09.368612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:09.371400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:09.392295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:09.400756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:09.404964 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:09.406737 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:09.439053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lazy-loading 'flavor' on Instance uuid 0827026d-3f91-4e84-99a5-8aa298069db5 {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:09:09.640027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-85a973cf-1c56-45b3-bd9a-55b2e7b81659 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action" status: 200 len: 32 microversion: 2.1 time: 0.277314 Dec 15 16:09:09.648171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 186/389] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:09 2021] POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:09:09.668696 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:09.671853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:09.681842 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:09.682493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:09.683468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:09.684051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:10.113476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:09:10.114047 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:09:10.115155 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:09:10.116400 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:09:10.117368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:09:10.129906 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:10.131293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:10.133432 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:10.134770 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:10.149588 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:10.160669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-162b0f6c-02fa-4f1e-87eb-5b097ab3c668 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.506527 Dec 15 16:09:10.161283 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 187/390] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:09 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:10.182388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:10.182994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:10.193376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Getting quotas for project 79292acd0f5349ed8f0dc153ee4c983d. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:09:10.197673 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:10.198800 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:10.198911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:10.199597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:10.213077 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Getting quotas for user 167f076ea79547b6b93b25b80d24330a and project 79292acd0f5349ed8f0dc153ee4c983d. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:09:10.378342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:09:10.382901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d721d243-be0a-4253-bc0e-c296862c0341',volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:09:10.893492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cc8bc948-0d3a-48d0-b6e1-7b734899baef tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.105830 Dec 15 16:09:10.896201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 204/391] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:09:08 2021] POST /compute/v2.1/servers => generated 406 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:09:10.909063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:10.919691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:10.942057 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:10.948693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:10.949722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:10.955444 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.057317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:11.069107 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0ff2ddfa-5294-4d28-967b-efb7e08d88ee tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.906765 Dec 15 16:09:11.071337 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 188/392] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:10 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:11.077035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:11.083134 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:11.084963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3ecd70c4-75e8-42bb-9b4d-8d5c5d2e39f0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 28736 microversion: 2.1 time: 0.187326 Dec 15 16:09:11.085611 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 205/393] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:10 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 28736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:11.090633 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7b1ec78f-fd13-4eaa-b02c-aba0457acc0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:11.094586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7b1ec78f-fd13-4eaa-b02c-aba0457acc0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:11.108031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.108031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.108031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.108031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.288663 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7b1ec78f-fd13-4eaa-b02c-aba0457acc0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:11.303983 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7b1ec78f-fd13-4eaa-b02c-aba0457acc0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1088 microversion: 2.1 time: 0.215548 Dec 15 16:09:11.306880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 206/394] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:11 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1088 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:11.333834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe45f33d-03d7-4911-b076-96bfef3b09ba"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:11.336003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:11.384130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-158b960e-1bfc-44fe-8be0-0ed14914799f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 31170 microversion: 2.20 time: 0.311451 Dec 15 16:09:11.385091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 189/395] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:11 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 31170 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:11.390180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:11.390417 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.390880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.398369 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.398814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.412137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:11.435610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.436178 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.437039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.437544 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.627626 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] HTTP exception thrown: Invalid volume: volume fe45f33d-03d7-4911-b076-96bfef3b09ba is already attached to instances: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 Dec 15 16:09:11.632488 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Returning 400 to user: Invalid volume: volume fe45f33d-03d7-4911-b076-96bfef3b09ba is already attached to instances: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:09:11.638732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3c80d1ee-44bc-4b22-bdeb-4e609e8a058c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.328961 Dec 15 16:09:11.646134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 207/396] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:09:11 2021] POST /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments => generated 174 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:09:11.681999 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-c001c64f-ef2e-49a0-8595-cf8169013161 req-4d860837-863f-4ff3-b1d4-f15c52982d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:11.701935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:11.701935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:09:11.720698 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-c001c64f-ef2e-49a0-8595-cf8169013161 req-4d860837-863f-4ff3-b1d4-f15c52982d2a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.722099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-c001c64f-ef2e-49a0-8595-cf8169013161 req-4d860837-863f-4ff3-b1d4-f15c52982d2a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.773307 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-c001c64f-ef2e-49a0-8595-cf8169013161 req-4d860837-863f-4ff3-b1d4-f15c52982d2a service nova] Creating event network-changed:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:09:11.806271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-c001c64f-ef2e-49a0-8595-cf8169013161 req-4d860837-863f-4ff3-b1d4-f15c52982d2a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129709 Dec 15 16:09:11.817310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 208/397] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:11.826070 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:11.831420 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:11.842466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.844662 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:11.846330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:11.847136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.009194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lazy-loading 'services' on Instance uuid c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:09:12.136325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e8a950cf-7a4b-4ef9-8577-57c1464998bf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments/fe45f33d-03d7-4911-b076-96bfef3b09ba" status: 202 len: 0 microversion: 2.1 time: 0.316093 Dec 15 16:09:12.137382 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 209/398] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:09:11 2021] DELETE /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments/fe45f33d-03d7-4911-b076-96bfef3b09ba => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:12.163410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:12.178241 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:12.182411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:12.190324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f10e971b-740c-45e4-9208-0a6a3065b5a4 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.799003 Dec 15 16:09:12.192728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.192866 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 190/399] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:11 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:12.203193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.203193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.203193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.203648 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:12.203648 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:12.207822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.208298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.209098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.209558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.464605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:12.480372 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e6fa142f-16e2-4f95-ae99-0c97fd8224f9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.341745 Dec 15 16:09:12.481053 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 210/400] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:12 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:12.497721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:12.498766 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:12.516516 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.516949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.517792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.518247 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.580885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a07b374a-91e6-4251-9b8f-f152dac0dfcd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087658 Dec 15 16:09:12.583058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 211/401] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:09:12 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:12.587835 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:12.588664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:12.597527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.598298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.599311 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.599930 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.705497 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:12.716155 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c9868fbb-6f40-4a4b-a280-e5dd022db5ac tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1138 microversion: 2.1 time: 0.131854 Dec 15 16:09:12.718359 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 212/402] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:12 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1138 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:12.726931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:12.729199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:12.742087 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.742615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:12.743537 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:12.743973 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.254499 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6d5fec27-148a-4157-8073-d3f61dbf7509 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 200 len: 38272 microversion: 2.20 time: 13.534648 Dec 15 16:09:26.256759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 213/403] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:12 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 38272 bytes in 13538 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:26.262483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:26.263123 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:26.270139 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.270683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.271556 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.272240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.327072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ba0c3d7c-343d-4ab5-bd85-d7dcf56d2cc2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 37816 microversion: 2.1 time: 14.132641 Dec 15 16:09:26.328289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 191/404] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:12 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 37816 bytes in 14135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:26.351963 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:26.353848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:26.367662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.368257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.369583 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.370637 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.491178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:26.501545 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-eab7c432-4ac9-4293-b508-b71f538b0e3f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.243366 Dec 15 16:09:26.502322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 214/405] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:26 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:26.506931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:26.507991 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:26.515159 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.515608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.516393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.516823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.561868 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c71963ac-8477-4a8a-b319-4242a9250cab tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052312 Dec 15 16:09:26.562533 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 215/406] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:09:26 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:26.570413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:26.571222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:26.580471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.581206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.582369 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.582806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.637821 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:26.650888 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:26.651915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f39206d9-711d-4fb4-a857-f6361147b71c tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.315263 Dec 15 16:09:26.652704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 192/407] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:26 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:26.657240 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:26.657749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:26.659323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3c48b468-7adb-4333-b16e-1ba41e86585c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1186 microversion: 2.1 time: 0.092346 Dec 15 16:09:26.661260 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 216/408] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:26 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:26.672595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.673124 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.674120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:26.674740 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:26.700379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3864f3e9-6f36-42b4-97e8-03ed085f9e47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/ips" status: 200 len: 152 microversion: 2.20 time: 0.046548 Dec 15 16:09:26.701205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 193/409] 10.222.0.41 () {60 vars in 1288 bytes} [Wed Dec 15 16:09:26 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:27.339154 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:27.340329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:27.347593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.348293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.349277 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.349891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.444143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6c411ee7-82e8-4516-9dd9-74ba20119c0a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 38213 microversion: 2.1 time: 0.108459 Dec 15 16:09:27.444941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 217/410] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:27 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 38213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:09:27.519813 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:27.520599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:27.531220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.531592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.532400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.532838 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.575224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:27.576641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:27.584603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.585181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.586016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.586525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.628471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e8d1618d-edf6-43d3-b54a-b84de22baf2c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058449 Dec 15 16:09:27.632815 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 218/411] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:09:27 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:09:27.671996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:27.673342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:27.681921 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.682519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.683426 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.683963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.835673 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:27.844594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1e56b1e8-a510-47ec-8ecf-12f8bf0efa3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.178160 Dec 15 16:09:27.845370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 219/412] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:27 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:27.849745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:27.850737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:27.857588 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.858269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.859213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:27.860409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:27.922255 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:27.922433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:27.930555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8701d24c-bba6-4e15-968e-0b04c022ef39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1204 microversion: 2.1 time: 0.083989 Dec 15 16:09:27.930827 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-de9d790e-d88c-47e7-a7e9-3bb1d5aa36f1 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.415046 Dec 15 16:09:27.931455 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 220/413] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:27 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:27.931760 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 194/414] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:27 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:28.456449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:28.457646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:28.464258 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:28.464776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:28.466284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:28.466914 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:28.555192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b0da4777-a7db-4529-b8aa-77866336a8d1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 38213 microversion: 2.1 time: 0.102391 Dec 15 16:09:28.558363 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 221/415] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:28 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 38213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:09:28.641357 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:28.642318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:28.649363 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:28.649822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:28.650642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:28.651079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:28.696000 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-97a678bc-0218-4a63-9a05-522ec6ef947c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059179 Dec 15 16:09:28.701846 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 195/416] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:09:28 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:09:28.863147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:28.863833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427348669", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "759c34f4-14be-417a-897c-06d30e0fd249"}]}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:28.864280 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:28.871340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:28.872430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:28.873226 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:28.873654 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.034550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:29.042682 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dd48da24-7f4d-4405-8f6b-cdb3b769438a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.183374 Dec 15 16:09:29.044115 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 222/417] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:28 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:29.055929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:29.062481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:29.073218 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.073905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.074976 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.075557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.244948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:29.252405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1b9e3c99-43e7-410f-8e67-300f32d3fd39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.207207 Dec 15 16:09:29.253193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 223/418] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:29 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:29.261929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:29.262422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:29.268394 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.268832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.269610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.270036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.450745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:29.459702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c6095141-ffdc-4f7b-89cf-3f676aed0317 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.205298 Dec 15 16:09:29.461151 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 224/419] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:29 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:29.472590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-ebcc8a12-5089-43a5-922d-7e2d76ece909 req-285cdb66-94a4-4d59-97b3-f6df94401999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:29.474786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:29.474786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:09:29.484827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-ebcc8a12-5089-43a5-922d-7e2d76ece909 req-285cdb66-94a4-4d59-97b3-f6df94401999 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.485261 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-ebcc8a12-5089-43a5-922d-7e2d76ece909 req-285cdb66-94a4-4d59-97b3-f6df94401999 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.497736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-ebcc8a12-5089-43a5-922d-7e2d76ece909 req-285cdb66-94a4-4d59-97b3-f6df94401999 service nova] Creating event network-changed:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:09:29.503024 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-ebcc8a12-5089-43a5-922d-7e2d76ece909 req-285cdb66-94a4-4d59-97b3-f6df94401999 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040535 Dec 15 16:09:29.503881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 225/420] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:29.569550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:29.570566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:29.577950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.578466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.579298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.579807 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.672662 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3aff0981-3e17-4a9e-b0e6-5621cf87a841 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 200 len: 38340 microversion: 2.1 time: 0.107134 Dec 15 16:09:29.673329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 226/421] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:29 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 38340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:09:29.678328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:29.678874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:29.685750 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.686210 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.686990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:29.687419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:29.710552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lazy-loading 'flavor' on Instance uuid 635372a5-622f-42d6-9723-ae9c21ad0a24 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:09:45.712440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] validate_networks() for [('759c34f4-14be-417a-897c-06d30e0fd249', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:09:45.868907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1045553a-e86d-44e0-aa68-e4428e83f399 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 202 len: 0 microversion: 2.20 time: 16.194246 Dec 15 16:09:45.873157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 227/422] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:09:29 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 0 bytes in 16196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:09:45.875727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:45.876349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:45.883191 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:45.883630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:45.884607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:45.885036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:45.912130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6d131dd3-d49b-4eb3-bf95-bb8c56577d10 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/ips" status: 200 len: 145 microversion: 2.1 time: 0.041108 Dec 15 16:09:45.912710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 228/423] 10.222.0.41 () {58 vars in 1247 bytes} [Wed Dec 15 16:09:45 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:45.917102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:45.917696 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:45.923465 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:45.923982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:45.924749 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:45.925176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.061904 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.069222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-59abeaf7-8b21-4581-8a8e-caafc37d0a87 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.155566 Dec 15 16:09:46.070101 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 229/424] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:45 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:46.074328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:46.074929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:46.081190 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.081713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.082597 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.083097 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.085433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:09:46.085849 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:09:46.086354 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:09:46.086767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:09:46.087170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:09:46.095674 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.096116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.096911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.097377 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.115579 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:09:46.119645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Getting quotas for user 50f2f5e4390046308cce9ef7ab394abd and project 830aba5f3b33486d86fbcbc92dfdeb30. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:09:46.131716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:09:46.134039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:09:46.184233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-54d1e0f0-d793-4677-96aa-18533bab1d8d tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.324051 Dec 15 16:09:46.184895 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 196/425] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:09:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 17325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:09:46.189851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:46.190645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:46.196550 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.196993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.197774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.198227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.237924 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.247483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dcc4995d-6b68-4a4a-939a-f04a7dd94f18 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.175304 Dec 15 16:09:46.248538 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 230/426] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:46 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:46.252937 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-e6bc8227-e17f-46fb-b03b-a3f2df865bed req-59ce21c7-f0e5-4020-95e6-00cc6438dc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "name": "network-vif-plugged", "status": "completed", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:46.257090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:46.257090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:09:46.262514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-e6bc8227-e17f-46fb-b03b-a3f2df865bed req-59ce21c7-f0e5-4020-95e6-00cc6438dc56 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.263657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-e6bc8227-e17f-46fb-b03b-a3f2df865bed req-59ce21c7-f0e5-4020-95e6-00cc6438dc56 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.277732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-e6bc8227-e17f-46fb-b03b-a3f2df865bed req-59ce21c7-f0e5-4020-95e6-00cc6438dc56 service nova] Creating event network-vif-plugged:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:09:46.282624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-e6bc8227-e17f-46fb-b03b-a3f2df865bed req-59ce21c7-f0e5-4020-95e6-00cc6438dc56 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033037 Dec 15 16:09:46.283790 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 231/427] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:46.296245 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:46.297368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:46.304710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.305157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.305941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:46.306476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:46.346696 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.353982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f3235abb-e921-4c9a-ba53-d4504a526d50 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.167582 Dec 15 16:09:46.354750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 197/428] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:46 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:46.361140 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c5090e48-2f03-43a3-9b69-5f066ac28022 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:46.362053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c5090e48-2f03-43a3-9b69-5f066ac28022 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:46.434233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c5090e48-2f03-43a3-9b69-5f066ac28022 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.449224 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c5090e48-2f03-43a3-9b69-5f066ac28022 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1218 microversion: 2.1 time: 0.092225 Dec 15 16:09:46.450748 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 198/429] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:46 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:46.511374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.519152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.520741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:46.521893 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bab370e3-80bc-4f66-b143-31a74522984a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.237119 Dec 15 16:09:46.522480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 232/430] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:46 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:47.085879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:47.086680 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:47.093638 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.094097 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.094910 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.095351 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.226756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.233906 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a55284ad-853d-45fb-adf9-7b4b97c3b480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.151737 Dec 15 16:09:47.234621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 199/431] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:47 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:47.265001 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:47.265674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:47.271967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.272419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.273179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.273604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.374207 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:47.375117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:47.383209 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.383941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.385320 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.386331 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.412959 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.420841 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9ea8c47c-9366-4b9f-8a88-12870e3f9d12 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.160154 Dec 15 16:09:47.421627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 233/432] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:47 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:47.467710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:47.468398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:47.504363 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.504820 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.505632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.506075 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.536615 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.544122 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-22de3731-ebc0-4608-bda5-c99c372f3836 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.175685 Dec 15 16:09:47.578836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 200/433] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:47 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:47.586294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:47.586989 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:47.593717 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.604518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.605044 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.605826 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:47.607411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:47.610955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bb7f9795-78c7-4aa1-9c75-0c221eedd5e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1270 microversion: 2.1 time: 0.146864 Dec 15 16:09:47.612246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 234/434] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:47 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:47.758003 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.766266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.767783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:47.769245 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-eb668816-7bcb-4b11-9e3d-57ee289d0579 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.189412 Dec 15 16:09:47.769994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 201/435] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:47 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:48.250914 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:48.251545 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:48.257546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.257989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.258891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.259377 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.307553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-cbee89cf-3715-4d52-87fd-60b10bc5cb91 req-b5f2ae63-6bc5-4a88-82b0-a439271cc039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "name": "network-vif-plugged", "status": "completed", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:48.310884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:48.310884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:09:48.330799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-cbee89cf-3715-4d52-87fd-60b10bc5cb91 req-b5f2ae63-6bc5-4a88-82b0-a439271cc039 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.331516 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-cbee89cf-3715-4d52-87fd-60b10bc5cb91 req-b5f2ae63-6bc5-4a88-82b0-a439271cc039 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.343750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-cbee89cf-3715-4d52-87fd-60b10bc5cb91 req-b5f2ae63-6bc5-4a88-82b0-a439271cc039 service nova] Creating event network-vif-plugged:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:09:48.349148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-cbee89cf-3715-4d52-87fd-60b10bc5cb91 req-b5f2ae63-6bc5-4a88-82b0-a439271cc039 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045209 Dec 15 16:09:48.350050 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 202/436] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:48.407376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:48.414920 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-70fb1790-d727-44a4-bcca-85f7cc9db2f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.168132 Dec 15 16:09:48.415852 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 235/437] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:48 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:48.439042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:48.439739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:48.447513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.448095 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.448882 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.449470 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.595341 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:48.599363 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:48.605289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.605756 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.606901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.607340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.749460 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:48.757586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7036f023-a694-4453-8397-f1e98f3114de tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.322952 Dec 15 16:09:48.758886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 203/438] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:48 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:48.769716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b7ddce-face-4d4e-89a3-987cdadf0f5c"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:48.771318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:48.778566 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.780140 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.781125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.781930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.806470 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:48.814531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2cde1d77-8b11-44a5-ab8b-60841f7377b9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1359 microversion: 2.1 time: 0.223490 Dec 15 16:09:48.819204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 236/439] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:48 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:48.829000 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:48.829802 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:48.837313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.838427 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.839814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:48.840346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:48.998587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:49.006001 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-989588b6-5242-4705-b6d5-ebfe6b8f99b8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.184830 Dec 15 16:09:49.006945 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 237/440] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:48 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:49.011500 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:49.012100 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:49.017816 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.018501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.019768 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.020056 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.101129 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-578c8e26-8061-4787-bfd0-384c8cbc9b2a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335364 Dec 15 16:09:49.107975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 204/441] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:09:48 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:49.187464 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:49.195465 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:49.197080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:49.198333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7ed0aa60-de1b-4cea-9ad6-cdf2ada90088 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.190371 Dec 15 16:09:49.198970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 238/442] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:49 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:49.305961 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-9bf570ed-4e7e-4f39-83d8-37fcffbaba1e req-e32ed972-dca1-465b-8137-eece29d89066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8328bb6e-1447-440f-a168-e7db971aeff6", "tag": "5c29cae1-ba11-45ac-b5fe-fcc0dfad0996"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:49.308388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:49.308388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:09:49.318093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-9bf570ed-4e7e-4f39-83d8-37fcffbaba1e req-e32ed972-dca1-465b-8137-eece29d89066 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.318883 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-9bf570ed-4e7e-4f39-83d8-37fcffbaba1e req-e32ed972-dca1-465b-8137-eece29d89066 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.331732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-9bf570ed-4e7e-4f39-83d8-37fcffbaba1e req-e32ed972-dca1-465b-8137-eece29d89066 service nova] Creating event network-changed:5c29cae1-ba11-45ac-b5fe-fcc0dfad0996 for instance 8328bb6e-1447-440f-a168-e7db971aeff6 on hv-cinder-80070 Dec 15 16:09:49.336653 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-9bf570ed-4e7e-4f39-83d8-37fcffbaba1e req-e32ed972-dca1-465b-8137-eece29d89066 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035290 Dec 15 16:09:49.337117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 205/443] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:09:49.431967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:49.432577 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:49.439659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.440103 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.440871 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.441300 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.578684 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:49.585967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-21670df9-a977-4097-b72d-b53224362fad tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.157506 Dec 15 16:09:49.586505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 239/444] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:49 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:49.777361 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:49.778105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:49.784211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.784650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.785423 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.785847 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.835266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:49.836279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:49.842295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.842740 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.843523 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:49.843948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:49.971632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:49.979020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c1107694-92fc-4f45-8778-2b7398f1e3cf tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1549 microversion: 2.1 time: 0.147464 Dec 15 16:09:49.979595 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 240/445] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:49 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:49.996403 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:49.997080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.003450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.003981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.004832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.005342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.006244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.013775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-abad8cdb-5297-499a-ad14-ef92ad83a376 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.241496 Dec 15 16:09:50.014388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 206/446] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:49 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:50.023349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:50.023948 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.030062 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.030545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.031633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.032165 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.158393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.166042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ed37f136-b294-487a-aaff-f2d142bd5727 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1549 microversion: 2.1 time: 0.173117 Dec 15 16:09:50.167323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 241/447] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:49 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:50.183024 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:50.187531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:50.187531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:09:50.188863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.189933 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Searching by: {'deleted': False, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d'} {{(pid=116081) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 16:09:50.197528 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.198063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.198949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.199397 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.291453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.multi_cell_list [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116081) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 16:09:50.302376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.312574 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-49541301-1781-435f-b00d-bdb4ffe2dfae tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.292603 Dec 15 16:09:50.323265 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 207/448] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:50 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:50.329506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:50.330412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.338345 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.339148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.339931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.340355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.395015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c81eb745-fafe-4354-9391-13fc2b872f33 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215398 Dec 15 16:09:50.395602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 242/449] 10.222.0.41 () {58 vars in 1124 bytes} [Wed Dec 15 16:09:50 2021] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:50.405382 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:50.406398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.412310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.412761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.413553 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.413978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.531933 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.541151 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.542776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.544055 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3b32cd39-546a-41fc-9f3a-2ffd28aeb60d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.219450 Dec 15 16:09:50.545199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 208/450] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:50 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:50.555246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.563129 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c56a634a-7a59-488a-98db-c9babf440fb7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1549 microversion: 2.1 time: 0.161336 Dec 15 16:09:50.563697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 243/451] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:50 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:50.601676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:50.602279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.608670 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.609115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.609874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.610345 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.748152 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:50.755506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d4649285-ab88-4e53-b2af-fed0523ce0cc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1502 microversion: 2.1 time: 0.157433 Dec 15 16:09:50.756075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 209/452] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:50 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:50.772418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cf9c007-38de-40c6-9e89-1044a2e8d8a9"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:50.773583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.780248 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.780701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.781475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.781901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.808662 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] HTTP exception thrown: Cannot 'attach_volume' instance 0827026d-3f91-4e84-99a5-8aa298069db5 while it is in vm_state rescued Dec 15 16:09:50.809263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Returning 409 to user: Cannot 'attach_volume' instance 0827026d-3f91-4e84-99a5-8aa298069db5 while it is in vm_state rescued {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:09:50.811107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7dfaeefc-7c69-4ad2-86b7-d8a731eebed2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041935 Dec 15 16:09:50.811650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 244/453] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:09:50 2021] POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:09:50.820687 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:50.821416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.828390 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.829133 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.830636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.831597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.900472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-847c2e5f-0882-4449-87e1-80ccfcba8ae1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action" status: 202 len: 0 microversion: 2.1 time: 0.083827 Dec 15 16:09:50.901092 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 210/454] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:50 2021] POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:09:50.909290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:50.909904 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:50.916051 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.916495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:50.917276 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:50.917707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.031456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:51.032255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:51.038834 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:51.039459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.040895 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:51.041487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.056520 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:51.065680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-51364d9e-fcac-42ba-aebc-73667427c441 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1510 microversion: 2.1 time: 0.159706 Dec 15 16:09:51.070192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 245/455] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:50 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:51.252827 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:51.260049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9fb93d06-df27-426e-946a-c3f3abf4a062 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.233709 Dec 15 16:09:51.260954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 211/456] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:51 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:51.329284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:51.329889 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:51.336054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:51.336490 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.337262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:51.337691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.475639 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:51.483446 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6843252b-4c15-48ba-bfae-1939f71db0ea tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.158282 Dec 15 16:09:51.484004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 246/457] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:51 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:51.564346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:51.564972 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:51.570968 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:51.571415 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.572200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:51.572690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:51.697879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:51.705511 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:51.707023 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:51.708161 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4accdbec-c806-4847-828d-39f993dc424b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.148718 Dec 15 16:09:51.708723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 212/458] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:51 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:52.048108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7453ce8-d917-418c-a271-208103f6e5d1"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:52.049219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:52.055013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.055450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.056215 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.056646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.084093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:52.084700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:52.090518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.090969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.091742 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.092176 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.226429 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:52.234776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b17cb367-a47c-40b6-a5ac-b244105cabd9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1510 microversion: 2.1 time: 0.154231 Dec 15 16:09:52.235360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 213/459] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:52 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:52.277632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:52.278127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:52.285033 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.285634 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.286412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.286907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.304890 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c963e71c-493b-48a5-a57d-3f5c0d43fae5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260733 Dec 15 16:09:52.306063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 247/460] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:09:52 2021] POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:52.432075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:52.440750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e9e5827e-9585-4d4f-b1a8-1744974c5ae3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1260 microversion: 2.1 time: 0.167147 Dec 15 16:09:52.441632 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 214/461] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:52 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:52.500726 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:52.501408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:52.507838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.508278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.509044 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.509499 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.643688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:52.651090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dffca19d-cd82-4aff-816e-4c186dd830a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.154967 Dec 15 16:09:52.651658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 248/462] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:52 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:52.725449 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:52.726078 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:52.732860 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.733300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.734057 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:52.734514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:52.862809 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:52.870407 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:52.871887 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:52.873723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d105bec9-d9fa-40a7-89af-23273603118a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.151854 Dec 15 16:09:52.874299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 215/463] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:52 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:09:53.252915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:53.253421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:53.259724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.260165 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.260922 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.261346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.392109 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:53.399220 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-621310ab-9540-4232-8e3f-e872cf486cda tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1510 microversion: 2.1 time: 0.150273 Dec 15 16:09:53.399776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 249/464] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:53 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:53.457414 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:53.458019 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:53.463845 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.464289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.465051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.465486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.598091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:53.606170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-22ff491b-6efe-4b92-9e8b-24baaff77933 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1443 microversion: 2.1 time: 0.152317 Dec 15 16:09:53.607318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 216/465] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:53 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:53.623368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:53.623994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:53.629734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.630199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.630962 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.631388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.668312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:53.669541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:53.678112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.678586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.679379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.679814 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.773250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:53.781488 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8173a661-588c-43bf-a916-ab8e67a6100a tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1443 microversion: 2.1 time: 0.162080 Dec 15 16:09:53.782062 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 250/466] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:53 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:53.821558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:53.830918 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-59ec694a-e2fb-49af-a7db-51d72f79c3a1 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.166331 Dec 15 16:09:53.831638 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 217/467] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:53 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:53.892363 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:53.893161 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:53.900120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.900803 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:53.901765 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:53.902391 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:54.144817 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:54.152473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:54.153990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:54.155152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-05abb293-ebca-470e-bfe3-fbdfb9feaff0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.267126 Dec 15 16:09:54.155706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 251/468] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:53 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:54.416346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:54.417294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:54.424617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:54.425394 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:54.426741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:54.427609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:54.573304 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:54.580688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6d4c4a3b-26bf-4ee5-9a35-f07734a8a273 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1510 microversion: 2.1 time: 0.168450 Dec 15 16:09:54.581411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 218/469] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:54 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:54.848316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:54.848859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:54.855492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:54.855946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:54.856720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:54.857152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:55.090822 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:55.102979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a825780a-623f-4785-9541-9a398544d3d6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.257214 Dec 15 16:09:55.114667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 252/470] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:54 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:55.176104 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:55.176532 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:55.183901 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:55.184340 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:55.185919 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:55.186376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:55.334996 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:55.343586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:55.345086 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:55.346289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cb57949f-850e-4966-aecc-99118b37fdc1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.175192 Dec 15 16:09:55.346848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 219/471] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:55 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:55.597876 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:55.598514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:55.605023 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:55.605471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:55.606283 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:55.606769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:55.966659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:55.973898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fc32a491-7c0d-4883-ab30-f492a05f1f43 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1516 microversion: 2.1 time: 0.379813 Dec 15 16:09:55.974682 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 253/472] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:55 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:56.043456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-4fb43a2b-137e-4947-baaf-79266858d923 req-e50d7e50-07d7-4489-ad44-161b73b58727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:56.043456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:56.043456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:09:56.049637 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-4fb43a2b-137e-4947-baaf-79266858d923 req-e50d7e50-07d7-4489-ad44-161b73b58727 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:56.049941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-4fb43a2b-137e-4947-baaf-79266858d923 req-e50d7e50-07d7-4489-ad44-161b73b58727 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:56.062740 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-4fb43a2b-137e-4947-baaf-79266858d923 req-e50d7e50-07d7-4489-ad44-161b73b58727 service nova] Creating event network-changed:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:09:56.068161 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-4fb43a2b-137e-4947-baaf-79266858d923 req-e50d7e50-07d7-4489-ad44-161b73b58727 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032478 Dec 15 16:09:56.069533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 220/473] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:56.122355 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:56.122975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:56.130886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:56.131522 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:56.132725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:56.133259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:56.323958 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:56.335042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0af0db95-88ce-4a1a-a9ef-0b378037add8 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.216371 Dec 15 16:09:56.337451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 254/474] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:56 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:56.365818 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:56.366529 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:56.383022 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:56.384995 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:56.386058 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:56.393345 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:56.837141 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:56.850195 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:56.851873 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:56.853425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0c8ccd5e-93c4-4962-ab01-830bc1ad07a8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.492316 Dec 15 16:09:56.854169 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 221/475] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:56 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:57.353358 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:57.353831 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:57.360680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.361168 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.361886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.362345 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.495903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:57.497770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:57.500100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:57.507499 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.507943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.508932 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.509560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.511627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3eb0292c-f531-4d4b-8bc6-69da74ddfd4c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.162484 Dec 15 16:09:57.512245 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 255/476] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:57 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:09:57.665090 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:57.687167 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b2e218b5-ec71-46dc-a841-bd91f2a15408 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1516 microversion: 2.1 time: 0.182446 Dec 15 16:09:57.687167 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 222/477] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:57 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:57.693128 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8eec395-7b09-4b46-9a04-390c4b2da715"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:57.694258 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:57.700284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.700736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.701514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.701949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.788260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-22a14e55-ab19-421e-b464-b7fd7e7c3924 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:57.795613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22a14e55-ab19-421e-b464-b7fd7e7c3924 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.796063 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-22a14e55-ab19-421e-b464-b7fd7e7c3924 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.870897 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-22a14e55-ab19-421e-b464-b7fd7e7c3924 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Going to try to stop instance {{(pid=116080) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:09:57.913871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-22a14e55-ab19-421e-b464-b7fd7e7c3924 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 202 len: 0 microversion: 2.1 time: 0.129095 Dec 15 16:09:57.914639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 223/478] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:09:57 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:09:57.921018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:57.921722 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:57.929805 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.930202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.931001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.931479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.957648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9acc6dce-62f3-43a8-a3a0-8a456fc3efe2 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268017 Dec 15 16:09:57.962532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 256/479] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:09:57 2021] POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:57.968797 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:57.969638 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:57.977232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.977968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:57.979067 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:57.979564 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.084025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:58.093171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:58.094717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:58.095864 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-84e26e0a-7852-4c21-8a02-0063b77af8ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.179837 Dec 15 16:09:58.096425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 224/480] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:57 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:58.133148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:58.142288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-09de783d-a7ff-4b1e-aafd-b845d9a34623 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.178155 Dec 15 16:09:58.142981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 257/481] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:57 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:58.384730 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-d5fc64b7-1bba-42cc-af02-31947b9f0274 req-abaa0f8a-5329-4e1e-8d66-44fc21ace7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8328bb6e-1447-440f-a168-e7db971aeff6", "name": "network-vif-plugged", "status": "completed", "tag": "5c29cae1-ba11-45ac-b5fe-fcc0dfad0996"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:09:58.386264 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:09:58.386264 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:09:58.393257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-d5fc64b7-1bba-42cc-af02-31947b9f0274 req-abaa0f8a-5329-4e1e-8d66-44fc21ace7da service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.393802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-d5fc64b7-1bba-42cc-af02-31947b9f0274 req-abaa0f8a-5329-4e1e-8d66-44fc21ace7da service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.404845 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-d5fc64b7-1bba-42cc-af02-31947b9f0274 req-abaa0f8a-5329-4e1e-8d66-44fc21ace7da service nova] Creating event network-vif-plugged:5c29cae1-ba11-45ac-b5fe-fcc0dfad0996 for instance 8328bb6e-1447-440f-a168-e7db971aeff6 on hv-cinder-80070 Dec 15 16:09:58.409378 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-d5fc64b7-1bba-42cc-af02-31947b9f0274 req-abaa0f8a-5329-4e1e-8d66-44fc21ace7da service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028284 Dec 15 16:09:58.409996 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 225/482] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:09:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:09:58.529306 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:58.530184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:58.536592 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.537045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.538301 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:58.538786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:58.673031 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:58.680351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d9973599-4867-45a4-994e-7b93dd1ff447 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.155745 Dec 15 16:09:58.680917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 258/483] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:58 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:59.115192 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:59.115896 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:59.122224 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:59.122672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:59.123476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:59.123906 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:59.160294 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:59.160898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:59.167763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:59.168204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:59.169657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:59.170298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:59.301014 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:59.308691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-deee5218-770d-4936-b4f4-cbe0e6dfd8ab tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.152095 Dec 15 16:09:59.309264 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 259/484] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:59 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:09:59.319246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:59.329844 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:59.331667 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:59.332893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a427c750-9bc4-43df-ad56-62440d56cb98 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.222151 Dec 15 16:09:59.333909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 226/485] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:09:59 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:09:59.696408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:09:59.697022 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:09:59.703471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:59.703909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:59.704805 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:09:59.705065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:09:59.836174 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:09:59.845250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-78cd0c8e-a741-4081-823a-b3fa31915be7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.152439 Dec 15 16:09:59.845824 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 260/486] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:09:59 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:00.328043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:00.328820 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:00.335920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:00.336373 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:00.337161 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:00.337597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:00.350693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:00.351538 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:00.358279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:00.358800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:00.359649 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:00.360136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:00.498101 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:00.505837 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-778b2ef6-3135-4a81-ad09-f5f349a24080 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.183211 Dec 15 16:10:00.506433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 227/487] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:00 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:00.523898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:00.532235 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:00.533733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:00.534893 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f6c9c40b-352e-412e-a37b-7cdf78584cda tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.187898 Dec 15 16:10:00.535447 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 261/488] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:00 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:00.861565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:00.862192 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:00.867944 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:00.868384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:00.869144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:00.869577 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:00.999556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:01.006824 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-27c12a98-de55-4b83-b70b-94c7caf8fb35 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.148866 Dec 15 16:10:01.007395 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 228/489] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:00 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:01.522891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:01.523530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:01.530329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:01.530773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:01.531534 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:01.531963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:01.552011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:01.552616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:01.558890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:01.559341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:01.560122 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:01.560556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:01.661224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:01.669837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-acaa0e50-7b4c-43e4-8734-0981845b1ff1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.150532 Dec 15 16:10:01.670452 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 262/490] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:01 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:01.689457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:01.697218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:01.698735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:01.700395 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-976763bc-7558-4808-b45b-fed8808f2fa3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.151558 Dec 15 16:10:01.700997 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 229/491] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:01 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:02.023141 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:02.023750 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:02.030060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:02.030539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:02.031309 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:02.031742 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:02.161827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:02.169883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bf4830d8-c07e-4f1a-9771-62467da62d61 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.150311 Dec 15 16:10:02.170483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 263/492] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:02 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:02.687081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:02.687682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:02.693962 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:02.694430 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:02.695193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:02.695621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:02.718023 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:02.718650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:02.724800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:02.725238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:02.726001 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:02.726455 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:02.825397 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:02.833173 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-202656e6-b929-41d2-8f8a-40e57a33df1c tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.150378 Dec 15 16:10:02.833747 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 230/493] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:02 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:02.858441 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:02.866111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:02.867638 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:02.868785 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-39eefd9a-f09c-42a2-b1ea-753c6f42de42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.154412 Dec 15 16:10:02.869346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 264/494] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:02 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:03.187208 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:03.187944 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:03.193718 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:03.194201 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:03.195072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:03.195513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:03.338293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:03.345465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a0c0771c-c8e6-4f74-8dde-4ef7ab50c604 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.162765 Dec 15 16:10:03.346026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 231/495] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:03 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:03.851565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:03.852085 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:03.858958 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:03.859400 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:03.860162 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:03.860590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:03.887015 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:03.887622 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:03.893869 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:03.894367 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:03.895146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:03.895575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:03.992671 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:04.000872 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-df23489e-55a7-4249-a54a-9dd2acf08acc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.153035 Dec 15 16:10:04.001590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 265/496] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:03 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:04.029906 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:04.038126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:04.040080 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:04.041374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-432b4b43-5250-490b-a1ca-d63409edc100 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.158125 Dec 15 16:10:04.041877 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 232/497] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:03 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:04.362344 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:04.363025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:04.375969 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:04.376419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:04.377204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:04.377641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:04.512606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:04.520398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-70d2dca4-a266-4f1a-ade9-9e8cc15c70e0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1318 microversion: 2.1 time: 0.161964 Dec 15 16:10:04.520960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 266/498] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:04 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:05.017709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:05.018351 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:05.024601 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:05.025050 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:05.025823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:05.026349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:05.062129 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:05.062749 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:05.069157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:05.069806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:05.070618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:05.071044 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:05.175320 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:05.183186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d78ee673-89d6-4f67-8d25-b6867d4e7c23 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.169050 Dec 15 16:10:05.183757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 233/499] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:05 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:05.205625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:05.213141 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:05.214664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:05.215787 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5cffceff-7eb9-44ed-a95c-ef821b3dcbb2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.159545 Dec 15 16:10:05.216847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 267/500] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:05 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:05.536638 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:05.537376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:05.543508 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:05.543949 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:05.544703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:05.545159 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:05.670809 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:05.677995 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cefc3bf2-0c65-4820-b02a-64c9b945cf96 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1507 microversion: 2.1 time: 0.144936 Dec 15 16:10:05.678604 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 234/501] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:05 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:06.200108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:06.201329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:06.207539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:06.207977 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:06.208736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:06.209165 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:06.233690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:06.234435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:06.240779 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:06.241233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:06.242015 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:06.242478 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:06.345827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:06.353674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c4fec1ee-02c6-4d89-bba6-24f8e23cfc8d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.157127 Dec 15 16:10:06.354260 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 268/502] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:06 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:06.373939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:06.381611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:06.383151 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:06.384305 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9161801f-09f3-4586-acf5-0b197acab73c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.154759 Dec 15 16:10:06.384931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 235/503] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:06 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:07.370749 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:07.371351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:07.378196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:07.378635 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:07.379399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:07.379834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:07.402058 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:07.402710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:07.408974 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:07.410609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:07.411439 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:07.411897 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:07.524799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:07.529693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7de9e7fb-8088-423d-bcf5-8c07a44b27db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.162403 Dec 15 16:10:07.531240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 269/504] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:07 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:07.553282 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:07.561750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:07.563274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:07.564424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c1e1c453-83ee-495a-9f57-8d8f7f868914 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1743 microversion: 2.20 time: 0.166047 Dec 15 16:10:07.564983 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 236/505] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:07 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:08.548577 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:08.549181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:08.556919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:08.557347 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:08.558334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:08.558752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:08.582510 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:08.583220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:08.589686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:08.590131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:08.590930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:08.592051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:08.700060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:08.709576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5f827ff7-b084-4ca1-bc7a-d7aa01dc0933 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.165816 Dec 15 16:10:08.710181 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 270/506] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:08 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:08.722308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:08.730047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:08.731506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:08.732684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f8a0421f-8945-435d-aedf-cd3d55739efb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1743 microversion: 2.20 time: 0.153879 Dec 15 16:10:08.733231 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 237/507] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:08 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:09.726790 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:09.727398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:09.735295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:09.735746 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:09.736524 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:09.737375 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:09.750312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:09.751192 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:09.758706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:09.759257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:09.760127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:09.760572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:09.880377 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:09.888732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-198e5d15-2eab-46ec-9530-a195448ffa52 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.165514 Dec 15 16:10:09.889499 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 271/508] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:09 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:09.899101 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:09.907596 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:09.909128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:09.910376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-36cacdba-f2d0-46fa-81c3-4efc220e36dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.163652 Dec 15 16:10:09.910930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 238/509] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:09 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:10.534239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-eb925a35-35e1-47f0-8d7c-f99ca33e3413 req-5d1f3976-0753-47f9-a2e6-64491b248e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "name": "network-vif-plugged", "status": "completed", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:10.536049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:10.536049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:10:10.553463 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-eb925a35-35e1-47f0-8d7c-f99ca33e3413 req-5d1f3976-0753-47f9-a2e6-64491b248e4a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:10.554040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-eb925a35-35e1-47f0-8d7c-f99ca33e3413 req-5d1f3976-0753-47f9-a2e6-64491b248e4a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:10.579204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-eb925a35-35e1-47f0-8d7c-f99ca33e3413 req-5d1f3976-0753-47f9-a2e6-64491b248e4a service nova] Creating event network-vif-plugged:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:10:10.584859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-eb925a35-35e1-47f0-8d7c-f99ca33e3413 req-5d1f3976-0753-47f9-a2e6-64491b248e4a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054251 Dec 15 16:10:10.586444 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 272/510] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:10.904681 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:10.905433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:10.912728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:10.913415 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:10.914492 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:10.915185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:10.935905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:10.937496 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:10.949343 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:10.952456 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:10.953762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:10.954443 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:11.081750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:11.090140 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f5cd7db4-3e6a-4a86-8ac1-85eeceb1e2db tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.189198 Dec 15 16:10:11.101315 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 239/511] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:10 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:11.114007 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:11.123354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:11.125828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:11.127202 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4d76241c-3e98-490e-8038-dd1a2de96d8c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.198740 Dec 15 16:10:11.134930 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 273/512] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:10 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:12.108799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:12.109411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:12.117533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:12.118290 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:12.119177 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:12.119731 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:12.144726 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:12.145613 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:12.152685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:12.153443 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:12.154984 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:12.155895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:12.282611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:12.292218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-641724b6-96de-475b-8e79-2328ad30528f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.187692 Dec 15 16:10:12.293119 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 240/513] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:12 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:12.316503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:12.328078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:12.329866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:12.331031 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a70b826b-ec3c-46b0-9a3f-912c6651d401 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.190090 Dec 15 16:10:12.331742 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 274/514] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:12 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:13.308868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:13.309495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:13.316446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:13.317213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:13.318271 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:13.318918 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:13.349635 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:13.351221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:13.364405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:13.370829 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:13.372396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:13.372874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:13.470137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:13.480189 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-806e941b-a7df-4e35-b694-9b58e28274d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.174855 Dec 15 16:10:13.485916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 241/515] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:13 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:13.541587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:13.568677 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:13.570182 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:13.571334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c6a39ff7-a5f0-4fb2-acce-e2ec191e6b83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.225318 Dec 15 16:10:13.572000 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 275/516] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:13 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:14.503327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:14.504003 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:14.511069 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:14.511515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:14.513342 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:14.514143 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:14.589161 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:14.589804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:14.600157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:14.603057 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:14.604612 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:14.605206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:14.707468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:14.718640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e1935fc3-7f0a-4bf7-80b2-1baf526c7956 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.218894 Dec 15 16:10:14.730113 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 242/517] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:14 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:14.801633 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:14.809477 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:14.811551 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:14.812747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2127b28c-3c0b-4f64-a82a-ad7e03426431 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.227224 Dec 15 16:10:14.813257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 276/518] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:14 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:15.737252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:15.737854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:15.744627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:15.745336 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:15.746126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:15.746585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:15.830982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:15.832214 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:15.839138 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:15.839823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:15.842232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:15.842857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:15.905687 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:15.915641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-827d462a-b7ac-4083-a634-1a395f0b3b31 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.182030 Dec 15 16:10:15.923098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 243/519] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:15 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:16.008243 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:16.020364 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:16.021896 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:16.023068 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2f5672cc-43ae-42c6-a77a-556890ac7168 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.196018 Dec 15 16:10:16.023949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 277/520] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:15 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:16.933664 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:16.934325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:16.941202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:16.942000 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:16.943206 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:16.943716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:17.042098 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:17.042919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:17.051564 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:17.054310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:17.057219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:17.057647 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:17.118244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:17.128217 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-11800732-0f52-4d3f-9e9c-de9ba5faf545 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.198135 Dec 15 16:10:17.139080 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 244/521] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:16 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:17.263801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:17.274184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:17.276129 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:17.277379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-775a06d6-2254-43da-9541-565822128b53 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.240477 Dec 15 16:10:17.278601 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 278/522] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:17 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:17.494445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba9708aa-8c64-4af8-8e26-8cfaeed9e3ec"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:17.495700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:17.503401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:17.503972 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:17.504896 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:17.506029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:17.881968 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9a1b073c-a5a2-49af-bb55-49f63af3a660 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "POST /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391900 Dec 15 16:10:17.884250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 245/523] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:10:17 2021] POST /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:18.146243 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:18.147665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:18.153854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:18.154391 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:18.155232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:18.155729 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:18.298057 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:18.298817 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:18.301097 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:18.305623 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:18.306079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:18.308688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:18.309455 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:18.316585 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-58ebddbf-b10b-4165-b00c-693135242526 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.173629 Dec 15 16:10:18.317194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 279/524] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:18 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:18.476531 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:18.485431 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:18.487457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:18.488631 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3feca213-778d-4475-81c8-262da7054803 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.195996 Dec 15 16:10:18.489190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 246/525] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:18 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:18.987218 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:18.988072 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:18.994247 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:18.994886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:18.996212 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:18.996804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:19.158970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:19.167950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0adfcf24-2ecd-4fc4-85f0-82c57ce49cd3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1595 microversion: 2.1 time: 0.184505 Dec 15 16:10:19.168620 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 280/526] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:18 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1595 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:19.334058 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:19.334885 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:19.341098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:19.341554 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:19.342355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:19.342791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:19.476701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:19.484422 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2b854506-2fd1-4aae-89c3-85c4eb280408 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.154166 Dec 15 16:10:19.484989 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 247/527] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:19 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:19.509294 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:19.509975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:19.516646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:19.517182 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:19.518332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:19.518772 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:19.727517 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:19.736865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:19.738647 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:19.740024 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-71bba171-74ef-4d73-8459-b52eda0c2bd9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1738 microversion: 2.20 time: 0.235028 Dec 15 16:10:19.740565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 281/528] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:19 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:20.502783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:20.504184 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:20.513980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:20.514518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:20.515468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:20.516182 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:20.678923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:20.688067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bdb07c13-493f-4dbe-86df-403629753358 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.190581 Dec 15 16:10:20.688954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 248/529] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:20 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:20.773955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:20.775271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:20.787834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:20.788619 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:20.789876 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:20.790505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:21.036153 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:21.045329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:21.047430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:21.048859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-08df19cf-7404-42c2-ada9-e7ae5fac3750 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1720 microversion: 2.20 time: 0.293315 Dec 15 16:10:21.049495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 282/530] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:20 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:21.435560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-b63d2d83-b690-461c-998d-584c28d663d5 req-26c3b76a-9e52-485d-9413-c64720e53b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:21.437341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:21.437341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:10:21.445272 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-b63d2d83-b690-461c-998d-584c28d663d5 req-26c3b76a-9e52-485d-9413-c64720e53b3b service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:21.446063 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-b63d2d83-b690-461c-998d-584c28d663d5 req-26c3b76a-9e52-485d-9413-c64720e53b3b service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:21.459643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-b63d2d83-b690-461c-998d-584c28d663d5 req-26c3b76a-9e52-485d-9413-c64720e53b3b service nova] Creating event network-changed:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:10:21.466755 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-b63d2d83-b690-461c-998d-584c28d663d5 req-26c3b76a-9e52-485d-9413-c64720e53b3b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036859 Dec 15 16:10:21.468110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 249/531] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:10:21.709661 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:21.710632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:21.721278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:21.722762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:21.724731 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:21.725341 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:21.970689 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:21.979735 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e3f46e5a-6b7a-43e8-8e6d-a8957982ff59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.277722 Dec 15 16:10:21.980774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 283/532] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:21 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:22.071216 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:22.072544 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:22.086820 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:22.087278 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:22.088071 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:22.088485 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:22.351528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:22.367506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:22.372086 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:22.374138 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-00c60f29-df16-4765-b463-1729fa61a634 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1720 microversion: 2.20 time: 0.309413 Dec 15 16:10:22.377984 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 250/533] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:22 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1720 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:22.565627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-a3ec558e-7bb3-4062-b159-96865933f571 req-6deea7bf-0e57-44dc-a23f-b5ec3cca2d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "name": "network-vif-unplugged", "status": "completed", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:22.567443 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:22.567443 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:10:22.575996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a3ec558e-7bb3-4062-b159-96865933f571 req-6deea7bf-0e57-44dc-a23f-b5ec3cca2d8a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:22.576430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-a3ec558e-7bb3-4062-b159-96865933f571 req-6deea7bf-0e57-44dc-a23f-b5ec3cca2d8a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:22.589406 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-a3ec558e-7bb3-4062-b159-96865933f571 req-6deea7bf-0e57-44dc-a23f-b5ec3cca2d8a service nova] Creating event network-vif-unplugged:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:10:22.595846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-a3ec558e-7bb3-4062-b159-96865933f571 req-6deea7bf-0e57-44dc-a23f-b5ec3cca2d8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033401 Dec 15 16:10:22.596885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 284/534] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:22.926011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1800717611"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:22.926845 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:22.934558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:22.935302 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:22.936507 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:22.937084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:22.998312 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:22.998996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:23.004931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.005388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.006133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.006602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.076072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.network.security_group_api [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Adding security group 806d8c48-6851-4bc1-97e3-8d5b671c4b38 to port b63f7fb9-7756-47b1-b0b7-9773d09ed48c Dec 15 16:10:23.143573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:23.152237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-40927a04-5237-411e-8061-50f6dfeb49a7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1722 microversion: 2.1 time: 0.158323 Dec 15 16:10:23.152817 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 285/535] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:22 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:23.393620 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:23.394589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:23.401037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.401755 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.402825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.403478 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.451940 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a1d9b3d8-b8ec-4f87-85c5-f4f7109c1fcd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/action" status: 202 len: 0 microversion: 2.1 time: 0.529695 Dec 15 16:10:23.453695 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 251/536] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:10:22 2021] POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:10:23.461101 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:23.471056 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:23.484349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.484953 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.485745 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.486470 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.670010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:23.681598 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:23.684125 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:23.685707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6b69dca8-c87f-4afd-b222-64000ba8012a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1663 microversion: 2.20 time: 0.296913 Dec 15 16:10:23.691547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 286/537] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:23 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1663 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:23.703367 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-054c951c-3108-4a23-895a-6ee554fcd263 req-5a79b1dc-b209-492c-83d3-a7bf733208e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:23.706501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:23.706501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:10:23.722575 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-054c951c-3108-4a23-895a-6ee554fcd263 req-5a79b1dc-b209-492c-83d3-a7bf733208e5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.723365 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-054c951c-3108-4a23-895a-6ee554fcd263 req-5a79b1dc-b209-492c-83d3-a7bf733208e5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.736950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-054c951c-3108-4a23-895a-6ee554fcd263 req-5a79b1dc-b209-492c-83d3-a7bf733208e5 service nova] Creating event network-changed:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:10:23.745894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-054c951c-3108-4a23-895a-6ee554fcd263 req-5a79b1dc-b209-492c-83d3-a7bf733208e5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052815 Dec 15 16:10:23.747921 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 287/538] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:23.754629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d32ac1-9064-43be-8709-9da3910a3ce6"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:23.772576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:23.780344 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.780865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.782058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:23.782748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:23.844704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:23.854093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f47400e3-4e7a-486c-b0d0-0882c7e219d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1760 microversion: 2.1 time: 0.397354 Dec 15 16:10:23.858486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 252/539] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:23 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1760 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:24.146609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ed73b979-fc09-4ade-bc43-f46595dacad4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396860 Dec 15 16:10:24.147476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 288/540] 10.222.0.41 () {62 vars in 1363 bytes} [Wed Dec 15 16:10:23 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments => generated 188 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:10:24.169986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:24.171299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:24.178532 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.179284 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.180281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.181119 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.281743 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:24.282668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:24.292432 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.293153 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.294606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.295266 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.339465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:24.347254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0e2d9729-5029-42eb-8798-44ba247c56a9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1699 microversion: 2.1 time: 0.182161 Dec 15 16:10:24.347827 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 253/541] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:24 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1699 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:24.363718 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-03778b46-efba-4f9f-a624-d402b16e536d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:24.369309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03778b46-efba-4f9f-a624-d402b16e536d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.369749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03778b46-efba-4f9f-a624-d402b16e536d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.393400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-03778b46-efba-4f9f-a624-d402b16e536d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Going to try to start instance {{(pid=116080) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:10:24.395421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2d46d757-dfdf-41d5-a122-6fcb9a46304a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action" status: 202 len: 0 microversion: 2.20 time: 0.118062 Dec 15 16:10:24.396028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 289/542] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:10:24 2021] POST /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:10:24.404046 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:24.404273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:24.411309 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.411834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.412692 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.413197 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.439290 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-03778b46-efba-4f9f-a624-d402b16e536d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 202 len: 0 microversion: 2.1 time: 0.078878 Dec 15 16:10:24.439913 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 254/543] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:10:24 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:10:24.456642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:24.457571 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:24.464075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.464530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.465316 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:24.465798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:24.551558 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:24.567374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:24.569134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:24.570395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d437b430-4563-48bd-b447-8791cf26e012 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1749 microversion: 2.20 time: 0.170321 Dec 15 16:10:24.571018 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 290/544] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:24 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:24.610262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:24.618654 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cb482ada-7645-4a77-8966-c3f39374ef63 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.174260 Dec 15 16:10:24.619225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 255/545] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:24 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:25.588643 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:25.589171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:25.595423 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:25.595866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:25.596622 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:25.597049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:25.635769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:25.636506 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:25.643456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:25.643908 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:25.644692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:25.645130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:25.733605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:25.742252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:25.743768 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:25.744940 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-93f215b7-1472-4afc-926f-693ec247b644 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1749 microversion: 2.20 time: 0.160030 Dec 15 16:10:25.745507 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 291/546] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:25 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:25.785348 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:25.793293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-97236e2e-9832-4e80-bd83-ec27547252f8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.161173 Dec 15 16:10:25.794410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 256/547] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:25 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:26.763848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:26.764448 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:26.770704 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:26.771148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:26.771918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:26.772348 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:26.811315 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:26.812022 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:26.818232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:26.818685 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:26.819507 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:26.819949 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:26.902135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:26.910895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:26.913563 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:26.915172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ce87b69a-6d9e-407e-8578-f78e6fc2ff4c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1749 microversion: 2.20 time: 0.155468 Dec 15 16:10:26.915807 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 292/548] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:26 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:26.950670 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:26.958439 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2c78d57f-8755-41a9-91fc-60667609ca89 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.151216 Dec 15 16:10:26.959011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 257/549] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:26 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:27.906795 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:27.907823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:27.915607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:27.922721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:27.923756 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:27.924449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:27.934006 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:27.934683 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:27.947314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:27.949342 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:27.952337 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:27.953100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:27.957833 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lazy-loading 'flavor' on Instance uuid 0827026d-3f91-4e84-99a5-8aa298069db5 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:10:28.162676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:28.179164 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:28.180815 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:28.182059 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-26fd9841-cbb6-4f52-ad19-371b90a361c7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.253038 Dec 15 16:10:28.193125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 258/550] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:27 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:28.193125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:28.193125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:28.193497 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:28.193985 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:28.194856 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:28.195308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:28.215201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7811b60e-0153-4f67-b7d7-83ea9e594047 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action" status: 200 len: 32 microversion: 2.1 time: 0.312615 Dec 15 16:10:28.216440 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 293/551] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:10:27 2021] POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:10:28.225603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:28.227968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:28.232568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:28.233020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:28.233813 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:28.234274 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:28.375046 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:28.378274 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:28.384010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9f4c82dc-5df8-4311-b60f-549877d0b3e9 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.200318 Dec 15 16:10:28.384581 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 259/552] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:28 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:28.386262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e4f5e0c4-ffb8-4e5b-87cb-e8cc94e4b631 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.164390 Dec 15 16:10:28.386744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 294/553] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:28 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:29.200345 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:29.200975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:29.207266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:29.207704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:29.208461 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:29.208888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:29.338965 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:29.347459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:29.348943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:29.350070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-62c9647e-344c-4cf7-b1f0-c67670daab7b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.153364 Dec 15 16:10:29.350662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 260/554] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:29 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:29.401352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:29.402021 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:29.403924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:29.404612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:29.408896 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:29.409337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:29.410103 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:29.410346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:29.410629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:29.410805 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:29.411580 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:29.412010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:29.545038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:29.555624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1ce02248-cb4c-4ac1-95f6-c5af9d7964aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.157771 Dec 15 16:10:29.558265 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:29.565072 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 295/555] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:29 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:29.569495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-863e1208-c53f-43f3-8737-021c142a9418 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.169569 Dec 15 16:10:29.570147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 261/556] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:29 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:30.368580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:30.369171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:30.375114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:30.375554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:30.376308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:30.376733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:30.503410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:30.511560 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:30.513555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:30.514738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-95ee267d-9ad7-4bba-a0b6-48cd32ad5fe7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.149803 Dec 15 16:10:30.515325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 296/557] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:30 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:30.571878 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:30.572479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:30.579068 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:30.579513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:30.580276 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:30.580701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:30.587223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:30.587829 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:30.593630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:30.594083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:30.594980 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:30.595416 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:30.711941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:30.719770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fd09dd96-ebe8-42fd-94c9-b25792dc6a16 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.151378 Dec 15 16:10:30.720336 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 262/558] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:30 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:30.726331 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:30.734037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9586ea2f-b715-432b-bfaf-feffd9368406 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.150796 Dec 15 16:10:30.734630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 297/559] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:30 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:31.533077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:31.533678 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:31.539720 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:31.540160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:31.540920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:31.541346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:31.735908 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:31.736502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:31.742737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:31.743177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:31.743993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:31.744425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:31.754088 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:31.763739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:31.765260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:31.766453 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8d39dfc0-5d45-40eb-b5c9-068360f6517e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.237578 Dec 15 16:10:31.767012 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 263/560] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:31 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:31.771591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:31.772348 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:31.778466 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:31.779707 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:31.780513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:31.781110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:31.879550 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:31.887869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dd939f28-7abd-49e5-b965-37de9e65fbe3 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1708 microversion: 2.1 time: 0.155506 Dec 15 16:10:31.889058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 298/561] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:31 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:31.923860 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:31.931785 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-af3c2a6c-837a-42a1-a067-6c388b80f8cd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.163641 Dec 15 16:10:31.932344 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 264/562] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:31 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:32.784584 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:32.785188 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:32.791733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:32.792186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:32.792966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:32.793399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:32.906223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:32.906844 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:32.913152 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:32.913608 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:32.914673 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:32.915120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:32.922936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:32.931233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:32.932739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:32.933887 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a1d024bb-0c6d-4839-b8fc-a098ec9448c8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.152985 Dec 15 16:10:32.934479 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 299/563] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:32 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:32.948270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:32.948994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:32.954934 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:32.955601 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:32.956375 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:32.956975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:33.045525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:33.053378 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9446c31c-dd30-4966-bb25-e55114520cbd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1712 microversion: 2.1 time: 0.151288 Dec 15 16:10:33.054027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 265/564] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:32 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:33.086103 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:33.094492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-712b95b4-b24c-46a8-b190-248227eac480 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.149744 Dec 15 16:10:33.095061 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 300/565] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:32 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:33.952334 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:33.952935 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:33.959323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:33.959773 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:33.960543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:33.960992 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:34.090556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:34.098773 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:34.100389 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:34.101565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-21af5b6c-a0b2-40eb-8d93-5e01cb9affd3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.152898 Dec 15 16:10:34.102127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 266/566] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:33 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:34.111573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:34.112257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:34.118586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:34.119038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:34.119808 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:34.120239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:34.249812 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:34.257473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dfdbc1db-9e89-48fb-a32b-0852c25803b4 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.149514 Dec 15 16:10:34.258052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 301/567] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:34 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:35.119141 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:35.119741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:35.126693 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:35.127137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:35.127936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:35.128696 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:35.256859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:35.265606 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:35.267121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:35.268301 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1567a1ba-9801-4378-b152-2c6438a26fc3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.152873 Dec 15 16:10:35.268865 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 267/568] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:35 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:35.274295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:35.274910 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:35.281174 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:35.281625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:35.282433 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:35.282873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:35.410992 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:35.418978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8c9f4d8e-51df-4160-afbc-7969092a39a9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.148336 Dec 15 16:10:35.420069 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 302/569] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:35 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:36.286208 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:36.286823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:36.293324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:36.293771 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:36.294565 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:36.294998 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:36.427474 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:36.435770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:36.436259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:36.436865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:36.437279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:36.438463 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bd93d479-e1d4-4d80-9f88-f6c2c8459954 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.155912 Dec 15 16:10:36.439010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 268/570] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:36 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:36.443147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:36.443593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:36.444405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:36.444843 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:36.575826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:36.583718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-92bdf9ad-9b41-4e70-a1c8-f30e0596e10b tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.151048 Dec 15 16:10:36.584566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 303/571] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:36 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:37.456223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:37.456931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:37.463518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:37.463982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:37.464822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:37.465260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:37.595850 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:37.600787 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:37.601522 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:37.604942 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:37.606570 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:37.607786 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-343b5fb2-a8b0-48d7-b50e-983ddeb220c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1751 microversion: 2.20 time: 0.155367 Dec 15 16:10:37.608424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 269/572] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:37 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:37.608592 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:37.608997 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:37.609851 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:37.610327 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:37.747375 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:37.755197 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bf066ea0-fd78-4f55-a4ba-3852cd82e9f6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.157969 Dec 15 16:10:37.755761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 304/573] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:37 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:38.095466 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.095953 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:38.101713 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.102172 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.102981 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.103412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.224052 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lazy-loading 'services' on Instance uuid 8328bb6e-1447-440f-a168-e7db971aeff6 {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:10:38.333855 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-27ff241b-30fa-4113-aa24-1c57ec9a27dc tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments/ba9708aa-8c64-4af8-8e26-8cfaeed9e3ec" status: 202 len: 0 microversion: 2.1 time: 0.241918 Dec 15 16:10:38.334490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 270/574] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:10:38 2021] DELETE /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments/ba9708aa-8c64-4af8-8e26-8cfaeed9e3ec => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:10:38.342718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.343705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:38.349561 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.349998 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.350979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.351560 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.383635 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7752f99f-2de3-4ac7-b134-fbe7885d87d4 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Dec 15 16:10:38.384197 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 305/575] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:10:38.627049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.627777 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:38.633851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.634348 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.635131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.635567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.772612 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:38.773228 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:38.779976 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.780419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.781186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:38.781617 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:38.824627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:38.833057 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:38.834645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:38.835790 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2d20092a-f29c-4993-9618-8b030bc9231a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.214157 Dec 15 16:10:38.836354 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 271/576] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:38.910041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:38.918031 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c9f14213-481f-49ef-b99e-481ca542ca65 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.149135 Dec 15 16:10:38.918749 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 306/577] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:38 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:39.394951 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:39.396257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:39.402401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:39.402849 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:39.403682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:39.404609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:39.438451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a5936f9b-9443-4172-9504-36d9ebdc7075 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047115 Dec 15 16:10:39.439024 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 272/578] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:10:39 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:10:39.857379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:39.858693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:39.866432 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:39.867166 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:39.868151 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:39.868786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:39.936473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:39.937693 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:39.951930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:39.952487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:39.959125 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:39.959691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:40.038599 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.052835 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.056870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.058225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-29591470-e23a-4384-a178-8db3a4b8e0aa tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.207072 Dec 15 16:10:40.058905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 307/579] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:39 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:40.104079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.112488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9060a805-1740-497b-b1d9-8cbcd75e8c9e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.180169 Dec 15 16:10:40.112985 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 273/580] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:39 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:40.632434 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:40.632940 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:40.638700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:40.639136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:40.639896 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:40.640321 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:40.664362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:10:40.739004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3d3cffbb-d223-4794-a65b-95bc48f06428 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 204 len: 0 microversion: 2.1 time: 0.109587 Dec 15 16:10:40.742811 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 308/581] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:10:40 2021] DELETE /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:10:40.747827 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:40.748891 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:40.755778 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:40.756493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:40.757501 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:40.758096 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:40.899440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:40.908118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d6f81847-72e2-483c-9992-e42336dacc26 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.164040 Dec 15 16:10:40.908897 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 274/582] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:40 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:41.077653 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:41.078357 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:41.084568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.085011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.085779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.086288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.130571 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:41.131179 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:41.137413 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.137893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.139228 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.139661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.216418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:41.237503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:41.239045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:41.240247 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-807b2c5c-9dc1-4806-b976-df188e49709c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.167200 Dec 15 16:10:41.240804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 309/583] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:41 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:41.274691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:41.282850 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2a9f7cc5-75b4-4b44-8a45-1187c3fa1cb0 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.156844 Dec 15 16:10:41.283376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 275/584] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:41 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:41.925646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:41.926299 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:41.932515 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.933177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:41.933957 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:41.934460 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.074809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.083026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4f743919-638f-449f-b7e2-1e4a393cfe68 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.161404 Dec 15 16:10:42.083816 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 310/585] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:41 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:42.258701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:42.259313 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:42.272831 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.273273 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.274130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.274689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.300566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:42.301436 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:42.307902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.308527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.309418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:42.310117 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:42.431411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.441428 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.444122 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.445405 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a81a0866-487d-4a36-a384-efee5ea0d961 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.190304 Dec 15 16:10:42.446530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 276/586] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:42 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:42.473167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:42.481562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2c89c3e0-65a8-4c53-a4bc-e4255edb2b1e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.185424 Dec 15 16:10:42.482176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 311/587] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:42 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:43.100096 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:43.100698 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:43.107015 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.107471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.108237 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.108667 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.243828 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.251803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b094ec3d-ac18-49a6-9b9a-1374d16edcde tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.155318 Dec 15 16:10:43.252563 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 277/588] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:43 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:43.464224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:43.464850 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:43.471060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.471505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.472271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.472709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.498858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:43.500152 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:43.507133 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.507917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.508931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:43.509615 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:43.615429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.624399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.625935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.627196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d178ed73-6081-463c-af4c-ddf141ffc190 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.166691 Dec 15 16:10:43.627762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 312/589] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:43 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:43.643710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:43.651484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ef4b7226-8245-4f73-ad16-0d3522fcb430 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.156750 Dec 15 16:10:43.652049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 278/590] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:43 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:44.268381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:44.269001 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:44.276096 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.276873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.278037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.279337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.413234 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.421650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-674a0b47-9efa-472b-8958-a5e75a68dfdd tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.156819 Dec 15 16:10:44.422449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 313/591] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:44 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:44.644627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:44.645220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:44.651666 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.652112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.652886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.653317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.668304 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:44.669147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:44.676411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.677145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.678093 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:44.678634 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:44.796467 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.808114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.810530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.811909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-63e60549-3bcb-4b24-abb0-359ed8d2cf67 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.171002 Dec 15 16:10:44.812993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 279/592] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:44 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:44.828929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:44.837452 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dbe53b1a-d450-4d98-92e5-2e3d22049dfb tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.172552 Dec 15 16:10:44.839356 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 314/593] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:44 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:45.438898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:45.439496 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:45.445528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.445977 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.446783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.447217 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.618714 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:45.626715 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b04214b3-5cd2-4817-be5f-6d86f3002da0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.191831 Dec 15 16:10:45.627425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 280/594] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:45 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:45.830269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:45.830863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:45.837073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.837507 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.838300 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.838727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.854313 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:45.854919 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:45.861686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.862124 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.862920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:45.863350 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:45.991713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:45.999975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:46.001456 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:46.002632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-83f443de-64d1-421c-b129-3eaa9454e7ee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.176253 Dec 15 16:10:46.003189 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 315/595] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:45 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:46.013225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:46.020858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-29b22785-1370-46f4-a9c9-b28a36f7efe7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.170123 Dec 15 16:10:46.021412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 281/596] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:45 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:46.644350 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:46.644954 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:46.651618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:46.652390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:46.653238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:46.654289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:46.977424 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:46.985675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4ba352cf-c74e-494b-9d46-eee70bacdbe0 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.345024 Dec 15 16:10:46.986252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 316/597] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:46 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:47.020805 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:47.021504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:47.032706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:47.033536 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.034605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:47.035435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.039352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:47.039964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:47.048249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:47.048710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.049516 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:47.049955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:47.176475 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.184452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.186490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.187625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6bf61288-309f-4fe6-9b08-acf942e71361 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.170507 Dec 15 16:10:47.188178 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 282/598] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:47.188318 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:47.196060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-928ba6c7-f8db-40bb-b092-021b64b94c01 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.161169 Dec 15 16:10:47.196616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 317/599] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:48.002457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.003093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:48.009163 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.009602 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.010411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.010840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.145820 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.154614 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-04b990f6-f7e2-42a6-baba-ad9054bd0ddf tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.154823 Dec 15 16:10:48.155386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 283/600] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:47 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:48.205537 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.206131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:48.212306 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:48.212683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.213029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:48.213238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.214020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.214475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.222200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.222200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.222200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:48.222567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:48.385778 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.393728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e12ab61c-7976-4131-acb5-c9f55ea8d2c5 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.184957 Dec 15 16:10:48.394665 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 284/601] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:10:48.403291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.418120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.421011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:48.423098 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2411ef1b-7fe6-4d1d-82e7-8c9870cbb6ad tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.220382 Dec 15 16:10:48.426198 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 318/602] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:48 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:49.171390 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.171992 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:49.178240 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.178689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.179458 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.179888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.318008 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:49.325491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ef0f0aae-b953-418b-a6e2-6e1eeac254f6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.157608 Dec 15 16:10:49.326376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 285/603] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:49.414287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.414998 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:49.420553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:10:49.421461 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: Wed Dec 15 16:10:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:10:49.422418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.422948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.423827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.424265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.441252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:49.441875 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:49.450051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.450538 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.452170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:49.452555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:49.583894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:49.591862 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1e91176e-8812-4385-a41a-af3754eabf13 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.183791 Dec 15 16:10:49.592434 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 319/604] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:49.608842 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:49.617374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:49.618932 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:49.620103 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-91347110-49eb-4eed-b277-7bf894af0a1c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.183324 Dec 15 16:10:49.620662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 286/605] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:49 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:50.342533 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:50.343137 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:50.349581 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.350025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.350830 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.351263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.489982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.497289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-825ec5e1-f303-45c5-b014-f1b23faf18e6 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.158447 Dec 15 16:10:50.497854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 320/606] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:50 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:50.608504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:50.609031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:50.615942 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.616524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.617293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.617717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.639371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:50.640064 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:50.646331 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.646780 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.647573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:50.648134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:50.770387 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.778441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2a51977c-eb74-41f7-a51d-b1ba169910e6 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.173512 Dec 15 16:10:50.783925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 287/607] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:50 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:50.794291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.803038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.804565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:50.805700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-398a3357-2034-4c08-b0c0-d927c4075ae8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.170008 Dec 15 16:10:50.806284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 321/608] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:50 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:51.513816 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:51.514446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:51.520734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.521174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.521931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.522455 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.652164 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:51.670765 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-818805d0-5847-4205-b671-220348f98958 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.160462 Dec 15 16:10:51.671346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 288/609] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:51 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:51.795799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:51.796364 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:51.802870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.803376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.804162 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.804606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.824963 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:51.825602 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:51.832856 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.833300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.834415 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:51.834848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:51.941629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:51.949638 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-24aaaec4-eec3-4bd3-bd2b-79899021347e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.157598 Dec 15 16:10:51.950232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 322/610] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:51 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:51.975067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:51.983426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:51.984908 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:51.986053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-951b8f09-cd2c-46ed-88a2-78a84a9a2f38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.165328 Dec 15 16:10:51.986642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 289/611] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:51 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:52.687529 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:52.688052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:52.693916 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:52.694398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:52.695169 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:52.695599 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:52.827237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:52.836450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0981d5b6-41ae-415b-8d25-cf4c9d601d7b tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.152589 Dec 15 16:10:52.837631 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 323/612] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:52 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:52.967165 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:52.967770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:52.974514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:52.974961 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:52.975758 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:52.976191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.003881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:53.004846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:53.011379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:53.012238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.013259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:53.013898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.107643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.115237 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-aa1f7a97-1e28-4725-b943-3e58456287ff tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.151795 Dec 15 16:10:53.115791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 290/613] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:52 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:53.146475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.155244 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.157323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.158509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9124d7de-2456-4d04-9d5e-3fd16a5e946f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.158175 Dec 15 16:10:53.159073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 324/614] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:52 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:10:53.853660 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:53.854291 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:53.860765 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:53.861206 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.861966 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:53.862420 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:53.985993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:53.993228 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d74d77a3-fb2d-4ffb-b8ad-de350072a724 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.143194 Dec 15 16:10:53.993784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 291/615] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:53 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:54.131337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:54.131904 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:54.138196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:54.138646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:54.139446 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:54.139875 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:54.176815 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:54.177407 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:54.183298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:54.183724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:54.184490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:54.184916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:54.276855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:54.284639 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-026100e9-c641-420c-be35-092790fd262f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.156978 Dec 15 16:10:54.285211 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 325/616] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:54 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:54.321256 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:54.331306 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:54.332864 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:54.334041 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d7289769-69c3-4fca-9217-603ab0ed35f2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.160782 Dec 15 16:10:54.334627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 292/617] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:54 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:55.009947 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:55.010566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:55.017188 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.017638 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.018437 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.018864 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.144127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.151384 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b670a72c-44c4-4eda-9d5e-056531e7d8a7 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.145567 Dec 15 16:10:55.151946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 326/618] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:55 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:55.302150 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:55.302813 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:55.309261 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.309699 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.310491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.310918 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.351952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:55.352668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:55.358483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.358920 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.359747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:55.360169 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:55.440923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.448636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b83f3028-eae7-4c93-9d1a-acb2e9375d55 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.150157 Dec 15 16:10:55.449193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 293/619] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:55 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:55.491882 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.500019 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.501512 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:55.502691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9a5635b5-f15d-4134-aa0d-6c54f62891bb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.154493 Dec 15 16:10:55.503252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 327/620] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:55 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:56.168801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:56.169326 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:56.175655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.176094 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.176851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.177291 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.372517 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.379751 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b7899649-fbfd-4157-a9ea-ba7c60f34b4f tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1513 microversion: 2.1 time: 0.214685 Dec 15 16:10:56.380319 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 294/621] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:56 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:56.466079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:56.466665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:56.473282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.473730 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.474537 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.474968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.520731 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:56.521334 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:56.527147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.528246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.529036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.529654 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.611969 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.620318 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0b670ead-5033-4bfd-b8f6-a3683f2cfaa1 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1568 microversion: 2.1 time: 0.157889 Dec 15 16:10:56.620870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 328/622] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:56 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:56.774701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-5933e8a7-ebb8-4ce9-abb2-37c5fb070854 req-c9f375c1-2080-48f7-8407-76ccd9a19d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8328bb6e-1447-440f-a168-e7db971aeff6", "name": "network-vif-deleted", "tag": "5c29cae1-ba11-45ac-b5fe-fcc0dfad0996"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:56.776917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:56.776917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:10:56.786533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.794645 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-5933e8a7-ebb8-4ce9-abb2-37c5fb070854 req-c9f375c1-2080-48f7-8407-76ccd9a19d56 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:56.795449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-5933e8a7-ebb8-4ce9-abb2-37c5fb070854 req-c9f375c1-2080-48f7-8407-76ccd9a19d56 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:56.796228 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.797756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:56.798943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c9544a9a-b9ce-4853-92e0-b4cc0fb5518d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.281937 Dec 15 16:10:56.799511 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 295/623] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:56 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:56.819118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-5933e8a7-ebb8-4ce9-abb2-37c5fb070854 req-c9f375c1-2080-48f7-8407-76ccd9a19d56 service nova] Creating event network-vif-deleted:5c29cae1-ba11-45ac-b5fe-fcc0dfad0996 for instance 8328bb6e-1447-440f-a168-e7db971aeff6 on hv-cinder-80070 Dec 15 16:10:56.824139 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-5933e8a7-ebb8-4ce9-abb2-37c5fb070854 req-c9f375c1-2080-48f7-8407-76ccd9a19d56 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053912 Dec 15 16:10:56.824803 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 329/624] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:10:57.396369 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.397080 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.403468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.403987 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.404831 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.405336 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.438858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.439515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.440106 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lazy-loading 'fault' on Instance uuid 8328bb6e-1447-440f-a168-e7db971aeff6 {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:10:57.479885 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.487036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7a42362c-9f8b-4249-81b3-b2c6cad1bc82 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 200 len: 1308 microversion: 2.1 time: 0.094306 Dec 15 16:10:57.487605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 296/625] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:57.637431 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.638114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.644709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.645146 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.645908 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.646371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.773393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.781711 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8f0119c6-5331-478b-8e56-f4b5a5095e88 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1548 microversion: 2.1 time: 0.148088 Dec 15 16:10:57.782303 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 330/626] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:57.798457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.799060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.804779 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.805224 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.805986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.806448 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.816213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.816804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.822491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.822931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.823687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.824114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.883003 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] HTTP exception thrown: Cannot 'detach_volume' instance 0827026d-3f91-4e84-99a5-8aa298069db5 while it is in vm_state rescued Dec 15 16:10:57.883623 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Returning 409 to user: Cannot 'detach_volume' instance 0827026d-3f91-4e84-99a5-8aa298069db5 while it is in vm_state rescued {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:10:57.884424 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ba3a89a8-f517-45b8-9260-e473f75d010a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments/b8eec395-7b09-4b46-9a04-390c4b2da715" status: 409 len: 152 microversion: 2.1 time: 0.089706 Dec 15 16:10:57.885173 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 297/627] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:10:57 2021] DELETE /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments/b8eec395-7b09-4b46-9a04-390c4b2da715 => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:10:57.893349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:10:57.893821 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.899495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.900045 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.900836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.901263 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.958683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.966585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3d3f5ba8-c989-4f76-8c48-6842ace81150 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action" status: 202 len: 0 microversion: 2.1 time: 0.077056 Dec 15 16:10:57.967164 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.970447 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 298/628] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:10:57 2021] POST /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:10:57.970602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:57.970602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8a413503-da01-4751-820d-b6d9bd69c268 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.157088 Dec 15 16:10:57.970602 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 331/629] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:57.983872 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:57.984724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:57.991124 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.991640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:57.992567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:57.993004 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.211564 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:58.220859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-dae0f1b4-ef1f-42de-a8c2-522106d387a7 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1556 microversion: 2.1 time: 0.244447 Dec 15 16:10:58.221426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 299/630] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:57 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:58.504310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:58.504792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 8328bb6e-1447-440f-a168-e7db971aeff6] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:58.511020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.511460 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.512270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.512697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.527332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] HTTP exception thrown: Instance 8328bb6e-1447-440f-a168-e7db971aeff6 could not be found. Dec 15 16:10:58.527929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Returning 404 to user: Instance 8328bb6e-1447-440f-a168-e7db971aeff6 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:10:58.529061 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8b003bde-ad44-4fdc-a83a-d5038ffc6340 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6" status: 404 len: 111 microversion: 2.1 time: 0.029045 Dec 15 16:10:58.529826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 332/631] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:58 2021] GET /compute/v2.1/servers/8328bb6e-1447-440f-a168-e7db971aeff6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:10:58.988186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:58.988784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:58.995079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.995521 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:58.996315 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:58.996744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.127713 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.136700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.138239 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.139374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a297cf75-c1e3-40d5-9a68-74ff5e2bf335 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.155498 Dec 15 16:10:59.139915 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 300/632] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:10:58 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:10:59.238075 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:59.238699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:59.245141 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.245579 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.246379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.246809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.375204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.383033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bed3c378-6a93-4ea0-a5dd-0c027dc06cfc tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1556 microversion: 2.1 time: 0.148532 Dec 15 16:10:59.383593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 333/633] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:59 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:10:59.659274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:59.659756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:59.665790 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.666260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.667025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.667451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.691870 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:10:59.763333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0dbe2830-d66a-4a97-9cd1-11e0d08cfa43 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 204 len: 0 microversion: 2.1 time: 0.107891 Dec 15 16:10:59.764060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 301/634] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:10:59 2021] DELETE /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:10:59.772196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:10:59.772847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:10:59.778739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.779192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.779977 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:10:59.780399 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:10:59.910972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:10:59.918458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7956dd7f-13eb-4004-bd97-529f88dd09ec tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1514 microversion: 2.1 time: 0.150090 Dec 15 16:10:59.919019 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 334/635] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:10:59 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:00.158231 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:00.158975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:00.165538 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.165987 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.166869 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.167314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.294067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.302214 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.303704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.304839 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-db0fa3ce-a2c9-49d9-8878-5f0ff4c16233 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.150669 Dec 15 16:11:00.305403 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 302/636] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:00 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:00.400541 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:00.401140 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:00.407427 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.407870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.408692 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.409079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.539866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:00.548076 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b06c4b04-09fd-49b9-9ea9-021426dc82d9 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1556 microversion: 2.1 time: 0.151165 Dec 15 16:11:00.548643 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 335/637] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:00 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:00.935142 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:00.935748 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:00.942140 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.942620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:00.943390 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:00.943822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.074448 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.082553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3f7f5b6c-0eae-4913-8b5c-fe03c23d295e tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1514 microversion: 2.1 time: 0.150949 Dec 15 16:11:01.083183 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 303/638] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:00 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:01.323501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:01.324107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:01.330422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.330901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.331672 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.332106 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.458387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.466707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.468147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.469308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1555a82f-ec64-4afc-a44a-e96eed66d350 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.149511 Dec 15 16:11:01.469854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 336/639] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:01 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:01.565076 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:01.565679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:01.571899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.572343 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.573107 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.573532 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.699764 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:01.707390 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c4bd313b-8f1f-4f88-bd28-a21a56d619c8 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1562 microversion: 2.1 time: 0.146528 Dec 15 16:11:01.707947 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 304/640] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:01 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:01.771503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:01.772097 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:01.777873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.778377 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.779152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.779594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.856331 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lazy-loading 'services' on Instance uuid 0827026d-3f91-4e84-99a5-8aa298069db5 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:11:01.923150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3cb3874b-b573-4155-8e84-1fa900d698ab tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments/b8eec395-7b09-4b46-9a04-390c4b2da715" status: 202 len: 0 microversion: 2.1 time: 0.155234 Dec 15 16:11:01.923721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 337/641] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:11:01 2021] DELETE /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments/b8eec395-7b09-4b46-9a04-390c4b2da715 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:01.931606 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:01.932578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:01.938675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.939120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.940000 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:01.940351 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:01.971294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1334f876-4ae7-4126-a709-d7a75347a553 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Dec 15 16:11:01.971903 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 305/642] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:11:01 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:02.099409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:02.100096 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:02.106060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.106543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.107313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.107743 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.240210 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.247600 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c27aa07b-f010-4212-9700-b0b7f2f20471 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 200 len: 1514 microversion: 2.1 time: 0.152229 Dec 15 16:11:02.248163 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 338/643] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:02 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:02.403434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-946e2ad1-60fa-4c46-998a-822a16a42bd5 req-6e3a4239-2891-4539-aeb7-14bf90b3e658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66", "name": "network-vif-deleted", "tag": "7ef3b7cf-db50-4eb4-95cc-9057ace1fddd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:02.405236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:02.405236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:11:02.414703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-946e2ad1-60fa-4c46-998a-822a16a42bd5 req-6e3a4239-2891-4539-aeb7-14bf90b3e658 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.415141 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-946e2ad1-60fa-4c46-998a-822a16a42bd5 req-6e3a4239-2891-4539-aeb7-14bf90b3e658 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.427617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-946e2ad1-60fa-4c46-998a-822a16a42bd5 req-6e3a4239-2891-4539-aeb7-14bf90b3e658 service nova] Creating event network-vif-deleted:7ef3b7cf-db50-4eb4-95cc-9057ace1fddd for instance c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 on hv-cinder-80070 Dec 15 16:11:02.433343 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-946e2ad1-60fa-4c46-998a-822a16a42bd5 req-6e3a4239-2891-4539-aeb7-14bf90b3e658 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Dec 15 16:11:02.433946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 306/644] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:02.491467 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:02.492857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:02.501801 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.502767 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.503626 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.504240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.640874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.649224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.650748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:02.651884 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8c0bf738-cec0-448d-ac9f-4f848a850ba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.166198 Dec 15 16:11:02.652433 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 339/645] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:02 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:02.983896 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:02.985613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:02.992357 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.992798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:02.993759 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:02.994210 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.025644 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b039d992-dd56-484d-a233-25a0e6b3bf18 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046159 Dec 15 16:11:03.026453 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 307/646] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:11:02 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:11:03.263869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.264735 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.270814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.271286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.272246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.272689 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.286254 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] HTTP exception thrown: Instance c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 could not be found. Dec 15 16:11:03.286894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Returning 404 to user: Instance c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:03.287650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b75916e9-b67a-4da9-b7e1-65c102ec44e2 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66" status: 404 len: 111 microversion: 2.1 time: 0.027604 Dec 15 16:11:03.288186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 340/647] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:03 2021] GET /compute/v2.1/servers/c3a2c9f0-613a-4f9f-bdb6-4592a0e2be66 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:03.296199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.297259 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.304730 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.305176 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.306060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.306471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.331328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:11:03.418380 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e8f31786-7b6d-4daf-a6b3-415b22bb6558 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 204 len: 0 microversion: 2.1 time: 0.125431 Dec 15 16:11:03.419188 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 308/648] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:11:03 2021] DELETE /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:11:03.427370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.428065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.437766 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.438241 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.439030 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.439464 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.576152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.584213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d6e2afb2-f37c-4c19-b600-09b07bc02dfb tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1513 microversion: 2.1 time: 0.160483 Dec 15 16:11:03.585003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 341/649] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:03 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:03.670778 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:03.671490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:03.677545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.677994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.678807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:03.679244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:03.807678 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.816229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.817782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:03.818968 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-50af9a9b-ce8a-4d9b-a1cc-97fd5a399b20 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.152163 Dec 15 16:11:03.819530 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 309/650] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:03 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:04.601614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:04.602242 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:04.608505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.608943 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.609706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.610134 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.736321 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.743773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-688c9008-5c4f-4dbd-9e6c-5342b1211b69 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1513 microversion: 2.1 time: 0.145758 Dec 15 16:11:04.744332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 342/651] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:04 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:04.837157 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:04.837674 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:04.844141 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.844593 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.845409 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:04.845843 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:04.972728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.980902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.982435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:04.983585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ee5e73a1-5541-4038-8aec-2264e4ea110d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.150136 Dec 15 16:11:04.984788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 310/652] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:04 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:05.153495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:05.154547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.160989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.161430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.162213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.162649 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.234326 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-79050f8d-5287-469b-9699-6a5d7cfbb5c7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/action" status: 202 len: 0 microversion: 2.1 time: 0.084264 Dec 15 16:11:05.238023 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 343/653] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:11:05 2021] POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:05.242993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.246342 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.252409 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.252938 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.254357 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.254622 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.329616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.330530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.336952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.337625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.338592 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.339211 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.370493 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:11:05.478240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3e08f817-8260-4673-b702-0db04e7d16d3 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 204 len: 0 microversion: 2.1 time: 0.153217 Dec 15 16:11:05.479536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 344/654] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:11:05 2021] DELETE /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:11:05.485781 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-c965c88e-1e98-4b43-8100-8743d7799c2e req-33a3fc4b-00dc-4e2a-b7f7-a5b7d7181eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "name": "network-vif-plugged", "status": "completed", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:05.487786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:05.487786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:11:05.495480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-c965c88e-1e98-4b43-8100-8743d7799c2e req-33a3fc4b-00dc-4e2a-b7f7-a5b7d7181eed service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.496139 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-c965c88e-1e98-4b43-8100-8743d7799c2e req-33a3fc4b-00dc-4e2a-b7f7-a5b7d7181eed service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.507899 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-c965c88e-1e98-4b43-8100-8743d7799c2e req-33a3fc4b-00dc-4e2a-b7f7-a5b7d7181eed service nova] Creating event network-vif-plugged:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:11:05.513354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-c965c88e-1e98-4b43-8100-8743d7799c2e req-33a3fc4b-00dc-4e2a-b7f7-a5b7d7181eed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032266 Dec 15 16:11:05.513955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 345/655] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:05.519384 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.520063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.526730 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.527285 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.528207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.528642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.641468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:05.649836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a7064d91-301c-4a20-9e6f-b8a3384a3b96 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1752 microversion: 2.1 time: 0.410346 Dec 15 16:11:05.650791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 311/656] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1752 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:05.669003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:05.676471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5497ca38-4977-4eb4-ae6c-85e6bd725c1d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1507 microversion: 2.1 time: 0.161378 Dec 15 16:11:05.677131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 346/657] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:05.760630 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:05.761362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:05.767274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.767798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:05.768687 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:05.769211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.003321 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:06.004448 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:06.011149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.011614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.012414 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.012877 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.025616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.037092 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-33de391e-af9b-474b-9fd6-32fa32e9bc1c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1513 microversion: 2.1 time: 0.279901 Dec 15 16:11:06.037877 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 312/658] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:06.162199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.171130 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.173421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.174624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-03ef4d76-fcb5-49d5-8695-d8f158d581e3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.176284 Dec 15 16:11:06.175394 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 347/659] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:05 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:06.199115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-f588efc0-33ea-47db-925e-4dec91fcba42 req-a6a6aef1-8f37-4480-b040-145caf9d435f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6231c6b-54bb-4377-9bea-f01ed2db96b2", "name": "network-vif-deleted", "tag": "137a78e4-d3b4-44b0-b61b-952fe0b633ba"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:06.200684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:06.200684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:11:06.208968 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f588efc0-33ea-47db-925e-4dec91fcba42 req-a6a6aef1-8f37-4480-b040-145caf9d435f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.209404 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-f588efc0-33ea-47db-925e-4dec91fcba42 req-a6a6aef1-8f37-4480-b040-145caf9d435f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.221400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-f588efc0-33ea-47db-925e-4dec91fcba42 req-a6a6aef1-8f37-4480-b040-145caf9d435f service nova] Creating event network-vif-deleted:137a78e4-d3b4-44b0-b61b-952fe0b633ba for instance b6231c6b-54bb-4377-9bea-f01ed2db96b2 on hv-cinder-80070 Dec 15 16:11:06.226739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-f588efc0-33ea-47db-925e-4dec91fcba42 req-a6a6aef1-8f37-4480-b040-145caf9d435f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Dec 15 16:11:06.227664 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 313/660] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:06.666949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:06.667555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:06.674263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.674824 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.675472 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.675902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.694448 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:06.695146 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:06.701131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.701613 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.702418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:06.702854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:06.823295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.832063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e21c11d7-a8c0-4d17-88ef-8dbbea2b9028 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1752 microversion: 2.1 time: 0.168932 Dec 15 16:11:06.832892 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 348/661] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:06 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:06.846084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:06.853541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ceb5a177-0fb4-4dde-b59a-53b91201443a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1507 microversion: 2.1 time: 0.163163 Dec 15 16:11:06.854105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 314/662] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:06 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:07.054721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.055256 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.061093 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.061546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.062845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.063279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.094673 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.095121 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.095614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lazy-loading 'fault' on Instance uuid b6231c6b-54bb-4377-9bea-f01ed2db96b2 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:11:07.143407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.150764 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-219ac616-ff00-484a-bae7-7959487cca17 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 200 len: 1307 microversion: 2.1 time: 0.099766 Dec 15 16:11:07.151333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 349/663] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:07.193336 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.193982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.200076 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.200520 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.201293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.201722 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.334542 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.342705 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.344318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:07.345453 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7c8501bb-750a-4d89-a3f0-843b18f34a31 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.156018 Dec 15 16:11:07.346014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 315/664] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:07.849295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.849930 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.856381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.856834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.857611 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.858046 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.870011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:07.870631 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:07.876911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.877352 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:07.878117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:07.878574 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.011397 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.016865 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.023973 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-66c0f52d-6ca3-4466-ae18-2cbc4a35260d tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1507 microversion: 2.1 time: 0.157534 Dec 15 16:11:08.024152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6f05dd50-28ee-49ae-9ebe-2815506b5a8d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.178336 Dec 15 16:11:08.024600 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 316/665] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:08.025323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 350/666] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:07 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:08.167776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:08.168378 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: b6231c6b-54bb-4377-9bea-f01ed2db96b2] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:08.174116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.174653 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.175456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.175891 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.188859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] HTTP exception thrown: Instance b6231c6b-54bb-4377-9bea-f01ed2db96b2 could not be found. Dec 15 16:11:08.189523 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Returning 404 to user: Instance b6231c6b-54bb-4377-9bea-f01ed2db96b2 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:08.190488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8c25287b-87df-45f5-b6bf-53f5706a7798 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2" status: 404 len: 111 microversion: 2.1 time: 0.026315 Dec 15 16:11:08.191025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 317/667] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:08 2021] GET /compute/v2.1/servers/b6231c6b-54bb-4377-9bea-f01ed2db96b2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:08.363724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:08.364415 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:08.370758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.371232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.372027 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:08.372457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:08.515046 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.523867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.525365 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:08.526611 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-67ce327e-4d3d-4fb3-b4b1-eb3a5f703462 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1807 microversion: 2.20 time: 0.166881 Dec 15 16:11:08.527271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 351/668] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:08 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:09.040831 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.041367 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.042496 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.043112 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.047729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.048180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.048955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.049361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.049465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.049812 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.050642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.051079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.180184 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.188118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3ef62c4d-3fdf-421a-8a34-87d35a7f3780 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1507 microversion: 2.1 time: 0.151269 Dec 15 16:11:09.188696 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 318/669] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:09.199322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.207683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-095afb86-ed10-43ba-a4e8-35037c9110f3 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.168766 Dec 15 16:11:09.208268 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 352/670] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:09.322657 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.323220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.329992 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.330505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.331353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.331752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.357244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:11:09.434212 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ade0cf7f-440a-4645-9531-0be6f3622115 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 204 len: 0 microversion: 2.1 time: 0.114866 Dec 15 16:11:09.435426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 319/671] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:11:09 2021] DELETE /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:11:09.443582 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.444543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.450386 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.450839 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.451647 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.452078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.545707 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:09.547330 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:09.556753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.557434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.558696 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.559323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.597226 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.604715 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b87a10fd-d699-455d-847d-fbf2dc0914a9 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1513 microversion: 2.1 time: 0.164825 Dec 15 16:11:09.605289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 353/672] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:09.774009 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.782513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.783999 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:09.785176 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d0ee80d9-4308-4e83-8b4c-fc47b936b7ed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1794 microversion: 2.20 time: 0.243768 Dec 15 16:11:09.786018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 320/673] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:09 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1794 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:09.857748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-91f4421f-b2db-4b5d-aca9-fb2cb7f1ed5c req-a0af1ae1-e65d-42e1-a860-b8f7196c29f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0724363-4d41-42f4-83b5-e32a4075c47d", "name": "network-vif-deleted", "tag": "bb16d956-defc-4ca5-b835-56a5f772cbb2"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:09.860127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:09.860127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:11:09.869995 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-91f4421f-b2db-4b5d-aca9-fb2cb7f1ed5c req-a0af1ae1-e65d-42e1-a860-b8f7196c29f4 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:09.870489 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-91f4421f-b2db-4b5d-aca9-fb2cb7f1ed5c req-a0af1ae1-e65d-42e1-a860-b8f7196c29f4 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:09.884851 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-91f4421f-b2db-4b5d-aca9-fb2cb7f1ed5c req-a0af1ae1-e65d-42e1-a860-b8f7196c29f4 service nova] Creating event network-vif-deleted:bb16d956-defc-4ca5-b835-56a5f772cbb2 for instance b0724363-4d41-42f4-83b5-e32a4075c47d on hv-cinder-80070 Dec 15 16:11:09.889721 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-91f4421f-b2db-4b5d-aca9-fb2cb7f1ed5c req-a0af1ae1-e65d-42e1-a860-b8f7196c29f4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035672 Dec 15 16:11:09.891080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 354/674] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:10.205133 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:10.205732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:10.212039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.212474 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.213238 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.213663 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.225439 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:10.226133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:10.232237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.232687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.233473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.234444 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.244872 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.245322 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.245769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lazy-loading 'fault' on Instance uuid b0724363-4d41-42f4-83b5-e32a4075c47d {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:11:10.285649 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.293121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-57e43027-ab47-4491-87f6-2cfb30403e3e tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 200 len: 1311 microversion: 2.1 time: 0.092224 Dec 15 16:11:10.293691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 321/675] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:10 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:10.382813 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.391107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-880481ec-3cbb-4b57-b332-95b450aecc40 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.170182 Dec 15 16:11:10.391681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 355/676] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:10 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:10.621682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:10.622314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:10.628784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.629223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.629980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:10.630430 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:10.757567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:10.764736 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-92d7ea48-2afa-46d4-803c-25570a546e99 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1513 microversion: 2.1 time: 0.146679 Dec 15 16:11:10.765888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 322/677] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:10 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:11.310309 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.310918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: b0724363-4d41-42f4-83b5-e32a4075c47d] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.317804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.318294 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.319076 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.319512 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.333418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] HTTP exception thrown: Instance b0724363-4d41-42f4-83b5-e32a4075c47d could not be found. Dec 15 16:11:11.333938 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Returning 404 to user: Instance b0724363-4d41-42f4-83b5-e32a4075c47d could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:11.334826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f1c91541-f280-4bad-93c0-f88afdca17bd tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d" status: 404 len: 111 microversion: 2.1 time: 0.028194 Dec 15 16:11:11.335379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 356/678] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:11 2021] GET /compute/v2.1/servers/b0724363-4d41-42f4-83b5-e32a4075c47d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:11.343782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.344302 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.350591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.351039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.351819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.352245 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.377830 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:11:11.408845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.409457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.416059 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.416505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.417991 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.418458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.462615 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-64ea728c-cd70-4314-9e1c-fc0036369809 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 204 len: 0 microversion: 2.1 time: 0.122452 Dec 15 16:11:11.463670 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 323/679] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:11:11 2021] DELETE /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:11:11.472671 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.473473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.480533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.481069 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.482039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.482501 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.577210 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.585451 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-358b9cc9-19ef-4425-8b94-4891b8e582c9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.180585 Dec 15 16:11:11.585953 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 357/680] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:11 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:11.683748 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.691020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-36030864-2b6f-4efa-b90b-3badebc3ccae tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.222849 Dec 15 16:11:11.691581 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 324/681] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:11 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:11.782574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:11.783312 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:11.789502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.789947 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.790746 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:11.791176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:11.919679 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f2f5e4390046308cce9ef7ab394abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830aba5f3b33486d86fbcbc92dfdeb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:11.928817 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-faa7ab2f-4527-4508-a93e-3a45423a3682 tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 200 len: 1513 microversion: 2.1 time: 0.150357 Dec 15 16:11:11.939746 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 358/682] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:11 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:11.994213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-b72e31cb-d963-47b4-82d1-0a82d44f4680 req-d874bc0a-8bc9-408b-8cb8-cb8278830a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132a29-e694-4b33-b9c1-3be0e2555008", "name": "network-vif-deleted", "tag": "eb06d20a-14b8-4cc1-8d1b-28c1855f50ed"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:11.995844 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:11.995844 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:11:12.003288 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-b72e31cb-d963-47b4-82d1-0a82d44f4680 req-d874bc0a-8bc9-408b-8cb8-cb8278830a44 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.003730 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-b72e31cb-d963-47b4-82d1-0a82d44f4680 req-d874bc0a-8bc9-408b-8cb8-cb8278830a44 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.016167 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-b72e31cb-d963-47b4-82d1-0a82d44f4680 req-d874bc0a-8bc9-408b-8cb8-cb8278830a44 service nova] Creating event network-vif-deleted:eb06d20a-14b8-4cc1-8d1b-28c1855f50ed for instance 90132a29-e694-4b33-b9c1-3be0e2555008 on hv-cinder-80070 Dec 15 16:11:12.021750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-b72e31cb-d963-47b4-82d1-0a82d44f4680 req-d874bc0a-8bc9-408b-8cb8-cb8278830a44 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031143 Dec 15 16:11:12.022393 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 325/683] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:12.602132 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.602795 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.609115 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.609565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.610408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.610842 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.708234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.708930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.715402 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.715858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.716639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.717077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.753956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:12.761790 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9045cf0c-8201-4292-9ce1-ccfd8048bb4d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.163272 Dec 15 16:11:12.762410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 359/684] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:12.844929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:12.852367 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a8e4b0fd-2318-4e0e-b408-91a1fd54aa9f tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.148123 Dec 15 16:11:12.852936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 326/685] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:12.945756 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:12.946340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] [instance: 90132a29-e694-4b33-b9c1-3be0e2555008] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:12.952105 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.952554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.953329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:12.953766 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:12.966760 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] HTTP exception thrown: Instance 90132a29-e694-4b33-b9c1-3be0e2555008 could not be found. Dec 15 16:11:12.967338 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] Returning 404 to user: Instance 90132a29-e694-4b33-b9c1-3be0e2555008 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:12.968631 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dad4496b-424e-4120-a957-65a962089b3c tempest-AttachVolumeNegativeTest-1913823585 tempest-AttachVolumeNegativeTest-1913823585-project] 10.222.0.41 "GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008" status: 404 len: 111 microversion: 2.1 time: 0.026061 Dec 15 16:11:12.969149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 360/686] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:12 2021] GET /compute/v2.1/servers/90132a29-e694-4b33-b9c1-3be0e2555008 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:13.779307 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:13.779916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:13.786633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.787101 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.787874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.788563 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.869091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:13.869699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:13.875948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.876401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.877184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:13.877622 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:13.986147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.000941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-527fe371-b2af-4143-a364-540beb4692db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.225274 Dec 15 16:11:14.004615 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 327/687] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:13 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:14.023903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:14.031967 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-232ba4f1-0fe0-47e6-a3db-bc9c105820ac tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.166568 Dec 15 16:11:14.032536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 361/688] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:13 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:15.020426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:15.021035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:15.027774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.028313 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.029096 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.029540 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.049333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:15.049960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:15.056471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.056912 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.057683 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:15.058108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:15.176460 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:15.184130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6c59a5c7-d3ff-437f-b1ad-d578170a3aa2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.167450 Dec 15 16:11:15.184890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 328/689] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:15 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:15.193481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:15.200881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3b62ca63-0069-4b86-97c2-6abb090307af tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.155684 Dec 15 16:11:15.201430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 362/690] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:15 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:16.054366 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-61c264ea-bdc8-4e74-a153-2066e92bab33 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f05143cfaf0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:16.099117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-61c264ea-bdc8-4e74-a153-2066e92bab33 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/173978d5-9641-4202-ad8d-5fe573cd0b20" status: 200 len: 351 microversion: 2.1 time: 0.048251 Dec 15 16:11:16.099678 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 329/691] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:16 2021] GET /compute/v2.1/os-volumes/173978d5-9641-4202-ad8d-5fe573cd0b20 => generated 351 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:16.202214 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:16.203475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:16.209867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.210364 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.211297 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.211806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.218668 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:16.219685 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:16.226098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.226820 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.227675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:16.228532 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:16.386507 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.394016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:16.395461 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3194f455-bbab-424f-ac7b-f62b74571e2d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.196748 Dec 15 16:11:16.396040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 363/692] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:16 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:16.403248 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4675e199-a632-4f4e-8257-e449e1f0e210 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1522 microversion: 2.1 time: 0.188682 Dec 15 16:11:16.403808 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 330/693] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:16 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:17.412586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.413720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:17.423499 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e27928a1-564a-42b6-879b-3acd72390ac4 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f0514294040>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.431852 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.432504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.433302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.433738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.496840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e27928a1-564a-42b6-879b-3acd72390ac4 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/5e2d05c2-e4d8-4b03-8d75-a6947148368f" status: 200 len: 350 microversion: 2.1 time: 0.072240 Dec 15 16:11:17.496840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 331/694] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/os-volumes/5e2d05c2-e4d8-4b03-8d75-a6947148368f => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:17.496840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:17.496840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:17.503701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.504807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.508381 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.514494 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.605809 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b884220871ec4a30b495f27c8c8b325b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365cc23ac7624aab91c3f286c2a4db76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.613361 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c03322c0-68d3-4d4f-877c-74a9a7e80c7a tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 200 len: 1480 microversion: 2.1 time: 0.120995 Dec 15 16:11:17.613925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 332/695] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 1480 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:17.618571 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-7da20d93-ca2f-4713-8d65-f1b33fe69b2a req-3d556344-fec0-479e-97e5-a2577886bfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0827026d-3f91-4e84-99a5-8aa298069db5", "name": "network-vif-deleted", "tag": "2b8a41c5-0444-446c-b2e7-113e3d782222"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:17.620119 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:17.620119 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:11:17.627440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-7da20d93-ca2f-4713-8d65-f1b33fe69b2a req-3d556344-fec0-479e-97e5-a2577886bfc5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:17.628076 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-7da20d93-ca2f-4713-8d65-f1b33fe69b2a req-3d556344-fec0-479e-97e5-a2577886bfc5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:17.641174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-7da20d93-ca2f-4713-8d65-f1b33fe69b2a req-3d556344-fec0-479e-97e5-a2577886bfc5 service nova] Creating event network-vif-deleted:2b8a41c5-0444-446c-b2e7-113e3d782222 for instance 0827026d-3f91-4e84-99a5-8aa298069db5 on hv-cinder-80070 Dec 15 16:11:17.647213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-7da20d93-ca2f-4713-8d65-f1b33fe69b2a req-3d556344-fec0-479e-97e5-a2577886bfc5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Dec 15 16:11:17.648341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 333/696] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:17.652082 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:17.661854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a7054eab-868e-4eb7-a621-9f7894da1b9e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.253260 Dec 15 16:11:17.662706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 364/697] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:17 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:18.631290 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.632026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] [instance: 0827026d-3f91-4e84-99a5-8aa298069db5] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:18.638129 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.638602 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.639377 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.639813 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.653020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] HTTP exception thrown: Instance 0827026d-3f91-4e84-99a5-8aa298069db5 could not be found. Dec 15 16:11:18.653599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] Returning 404 to user: Instance 0827026d-3f91-4e84-99a5-8aa298069db5 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:18.654436 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-03e35289-d7d6-493e-9e2d-dcafb5f4d552 tempest-ServerRescueNegativeTestJSON-933915019 tempest-ServerRescueNegativeTestJSON-933915019-project] 10.222.0.41 "GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5" status: 404 len: 111 microversion: 2.1 time: 0.027866 Dec 15 16:11:18.655135 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 334/698] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/servers/0827026d-3f91-4e84-99a5-8aa298069db5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:18.680481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.681079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:18.687697 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.688387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.689375 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:18.690063 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:18.877211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b74f64ba-1573-4c69-aceb-c9b801cae49c tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f0516abf790>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.922504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b74f64ba-1573-4c69-aceb-c9b801cae49c tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c07df922-4472-4e6b-a4fc-6e2480d0b398" status: 200 len: 350 microversion: 2.1 time: 0.049335 Dec 15 16:11:18.923054 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 335/699] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/os-volumes/c07df922-4472-4e6b-a4fc-6e2480d0b398 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:18.934227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-dd6b87fd-0080-4644-bf00-e16bf1f6c9f7 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f05142c8160>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:18.962923 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:18.971747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9ed7b29a-d912-4a1f-960f-794b8d9e4ce7 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.294855 Dec 15 16:11:18.972461 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 365/700] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.016267 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-dd6b87fd-0080-4644-bf00-e16bf1f6c9f7 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084806 Dec 15 16:11:19.017012 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 336/701] 10.222.0.41 () {58 vars in 1133 bytes} [Wed Dec 15 16:11:18 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.030592 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-003349da-e875-426e-8d53-55619d4129aa tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f0514146dc0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.111200 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-003349da-e875-426e-8d53-55619d4129aa tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084061 Dec 15 16:11:19.111854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 366/702] 10.222.0.41 () {58 vars in 1148 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:19.123302 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-79399b4c-a3eb-43b9-a8fc-ea1bb3804a57 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f05142f5550>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.200751 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-79399b4c-a3eb-43b9-a8fc-ea1bb3804a57 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.081023 Dec 15 16:11:19.201359 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 337/703] 10.222.0.41 () {58 vars in 1133 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.217898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-94199733-c795-4a3b-b01e-0981be8ffdd5 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f05141c3280>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.296501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-94199733-c795-4a3b-b01e-0981be8ffdd5 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082146 Dec 15 16:11:19.297574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 367/704] 10.222.0.41 () {58 vars in 1166 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:19.308926 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-00fa8474-dfcf-466b-b008-6e9fd04c4b63 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f05142f50d0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.386072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-00fa8474-dfcf-466b-b008-6e9fd04c4b63 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.080606 Dec 15 16:11:19.386684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 338/705] 10.222.0.41 () {58 vars in 1169 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:19.398217 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8319f46f-228c-4dca-9a72-95961bbe3e19 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f051414bd30>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.478627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8319f46f-228c-4dca-9a72-95961bbe3e19 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083806 Dec 15 16:11:19.479230 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 368/706] 10.222.0.41 () {58 vars in 1154 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.490729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b6f5391c-12e6-4009-824b-758abc884504 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f05143de4c0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.577639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b6f5391c-12e6-4009-824b-758abc884504 tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090425 Dec 15 16:11:19.578233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 339/707] 10.222.0.41 () {58 vars in 1187 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:19.589354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8d5e1499-5d18-4b7a-be66-faadcc0b272b tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] Calling method '.version_select at 0x7f051414b820>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.667041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8d5e1499-5d18-4b7a-be66-faadcc0b272b tempest-VolumesTestJSON-2065100822 tempest-VolumesTestJSON-2065100822-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.081259 Dec 15 16:11:19.667655 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 369/708] 10.222.0.41 () {58 vars in 1154 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:19.989215 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:19.989819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:19.996488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.996932 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:19.997717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:19.998149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:20.370876 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:20.379379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2a09f15b-1107-4c94-9e9e-80860f0c78e2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.394317 Dec 15 16:11:20.380033 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 340/709] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:19 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:21.395839 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:21.396604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:21.403700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.404051 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.408506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:21.411582 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:21.671011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:21.678923 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8e81cb7c-81cc-459f-bc1a-1e61cddaaeb9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.286868 Dec 15 16:11:21.679511 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 370/710] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:21 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:22.695662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:22.696260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:22.702507 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:22.702994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:22.703703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:22.704193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:22.847032 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:22.855164 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a8fb2f91-80a1-4b7f-ae22-71ba77c2f1af tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.163082 Dec 15 16:11:22.855814 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 341/711] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:22 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:23.039931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b417d1af-a6cf-438c-8ead-40803046a6e3 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Action: 'create', calling method: .version_select at 0x7f051414bb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-184775508"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:23.351239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b417d1af-a6cf-438c-8ead-40803046a6e3 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.444995 Dec 15 16:11:23.351906 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 371/712] 10.222.0.41 () {60 vars in 1154 bytes} [Wed Dec 15 16:11:22 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 446 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 16:11:23.363937 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-00ab5542-1c73-45a1-af53-b33024b234e9 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f0514514040>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:23.424508 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-00ab5542-1c73-45a1-af53-b33024b234e9 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 200 len: 344 microversion: 2.1 time: 0.065596 Dec 15 16:11:23.425412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 342/713] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:23 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:23.872509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:23.873249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:23.879090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.879529 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:23.880302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:23.880730 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.028208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:24.036503 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5c7091c3-9e04-4777-9635-4776d6cddabd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.167655 Dec 15 16:11:24.037074 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 372/714] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:23 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:24.075047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.075609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:24.081254 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.081830 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.082640 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:24.083142 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:24.166349 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lazy-loading 'services' on Instance uuid 854116b0-a886-4d4c-84c4-092c1f46b5dc {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:11:24.236034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6af77ef3-45d7-4f9e-a4d2-8e417768a18d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-volume_attachments/e8b7ddce-face-4d4e-89a3-987cdadf0f5c" status: 202 len: 0 microversion: 2.1 time: 0.165032 Dec 15 16:11:24.236701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 343/715] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:11:24 2021] DELETE /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-volume_attachments/e8b7ddce-face-4d4e-89a3-987cdadf0f5c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:24.437097 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d3892dec-0f37-4f94-8be5-5fbe5e316900 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f051414b160>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.484137 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d3892dec-0f37-4f94-8be5-5fbe5e316900 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 200 len: 345 microversion: 2.1 time: 0.050884 Dec 15 16:11:24.484792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 373/716] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:24.496235 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1e172cd9-7c83-4332-b4f0-d442eb5ad318 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Action: 'create', calling method: .version_select at 0x7f0514337d30>, body: {"snapshot": {"volume_id": "406b635a-84ab-4c69-a6c0-af261ab84d27", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-547031590"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:24.641491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1e172cd9-7c83-4332-b4f0-d442eb5ad318 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.149230 Dec 15 16:11:24.642140 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 344/717] 10.222.0.41 () {60 vars in 1161 bytes} [Wed Dec 15 16:11:24 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:24.651974 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9b84522b-295a-4d35-8f42-7d689f255c79 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141fcaf0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.682855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9b84522b-295a-4d35-8f42-7d689f255c79 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 200 len: 286 microversion: 2.1 time: 0.034312 Dec 15 16:11:24.683542 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 374/718] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:24.693726 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9913d52c-c743-40a1-8566-e4396e0c96d8 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05142b2670>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.723648 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9913d52c-c743-40a1-8566-e4396e0c96d8 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033691 Dec 15 16:11:24.724221 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 345/719] 10.222.0.41 () {58 vars in 1139 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:24.734354 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2bb4c648-dc29-4a74-9f7a-d93b2ea3da20 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f051419c0d0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:24.764329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2bb4c648-dc29-4a74-9f7a-d93b2ea3da20 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 200 len: 286 microversion: 2.1 time: 0.033459 Dec 15 16:11:24.764899 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 375/720] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:24 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:25.053971 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:25.054736 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:25.061186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.061634 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.062990 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:25.063428 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:25.215252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:25.223637 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0b4f065e-db56-4d23-b03e-fd594aa0130d tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.173254 Dec 15 16:11:25.224213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 346/721] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:25 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:25.776478 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-36113bf9-062a-4c68-b75d-4a80a7c53a8f tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141fcaf0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:25.804782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-36113bf9-062a-4c68-b75d-4a80a7c53a8f tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 200 len: 286 microversion: 2.1 time: 0.032306 Dec 15 16:11:25.805330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 376/722] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:25 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:26.240354 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:26.240950 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:26.247239 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.247679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.248440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:26.248869 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:26.391171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:26.399128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d110d23d-9282-4f44-8391-e3c4672a4bd9 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.162378 Dec 15 16:11:26.399689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 347/723] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:26 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:26.817437 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f8557b58-dd74-4f78-b89d-be8e9fd0089f tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f051414b040>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:26.844327 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f8557b58-dd74-4f78-b89d-be8e9fd0089f tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 200 len: 286 microversion: 2.1 time: 0.031876 Dec 15 16:11:26.844874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 377/724] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:26 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:27.416874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:27.417621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:27.423893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.424335 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.425094 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:27.425519 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:27.573499 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:27.581370 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0c13de27-6095-4d7d-b69f-9d623263ca2e tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1757 microversion: 2.1 time: 0.168357 Dec 15 16:11:27.581965 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 348/725] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:27 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:27.856325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7851773b-1c3f-4e64-b106-4d3b7c1b0bed tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141beaf0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:27.885156 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7851773b-1c3f-4e64-b106-4d3b7c1b0bed tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 200 len: 287 microversion: 2.1 time: 0.033155 Dec 15 16:11:27.885727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 378/726] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:27 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:27.896042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-759ebd28-96d5-40eb-a205-00e99bd11022 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05143de4c0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:27.948567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-759ebd28-96d5-40eb-a205-00e99bd11022 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 202 len: 0 microversion: 2.1 time: 0.056021 Dec 15 16:11:27.949138 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 349/727] 10.222.0.41 () {58 vars in 1253 bytes} [Wed Dec 15 16:11:27 2021] DELETE /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:11:27.958133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ee492af7-9013-463a-82f6-966ee89c3987 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141beb80>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:27.986981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ee492af7-9013-463a-82f6-966ee89c3987 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 200 len: 286 microversion: 2.1 time: 0.032782 Dec 15 16:11:27.987760 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 379/728] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:27 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:28.599290 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:28.599899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:28.605795 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.606274 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.607053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.607488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.664844 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-24d9b99f-0c29-41c3-94cf-72a5699ae810 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:28.670720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24d9b99f-0c29-41c3-94cf-72a5699ae810 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.671184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24d9b99f-0c29-41c3-94cf-72a5699ae810 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.731179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-24d9b99f-0c29-41c3-94cf-72a5699ae810 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Going to try to stop instance {{(pid=116081) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:11:28.757220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.766546 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-43a4d939-3f9c-44c8-8d55-eded1f0acb79 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1760 microversion: 2.1 time: 0.171268 Dec 15 16:11:28.767729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 350/729] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:28 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:28.783260 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-24d9b99f-0c29-41c3-94cf-72a5699ae810 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 202 len: 0 microversion: 2.1 time: 0.121892 Dec 15 16:11:28.784045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 380/730] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:11:28 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:11:28.800295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:28.801049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:28.807248 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.807777 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.808628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:28.809251 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:28.941075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:28.948908 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-17d6eb42-09bb-47af-933c-f4861d0bb4b4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.155083 Dec 15 16:11:28.949701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 351/731] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:28 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:28.999614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0d6c3754-f7ab-4491-bd20-e85617cda39b tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f0514221ca0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.026798 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-0d6c3754-f7ab-4491-bd20-e85617cda39b tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] HTTP exception thrown: Snapshot ce61951b-159e-41cb-a348-908a7462ebc1 could not be found. Dec 15 16:11:29.027396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0d6c3754-f7ab-4491-bd20-e85617cda39b tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Returning 404 to user: Snapshot ce61951b-159e-41cb-a348-908a7462ebc1 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:29.028202 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0d6c3754-f7ab-4491-bd20-e85617cda39b tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1" status: 404 len: 111 microversion: 2.1 time: 0.032987 Dec 15 16:11:29.028737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 381/732] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:11:28 2021] GET /compute/v2.1/os-snapshots/ce61951b-159e-41cb-a348-908a7462ebc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:29.037262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-eb4b090e-7b3e-41c8-bf6d-f5b6876b3144 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05142f5ca0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.099098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-eb4b090e-7b3e-41c8-bf6d-f5b6876b3144 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 202 len: 0 microversion: 2.1 time: 0.065298 Dec 15 16:11:29.099772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 352/733] 10.222.0.41 () {58 vars in 1247 bytes} [Wed Dec 15 16:11:29 2021] DELETE /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:11:29.110381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ebcc5dbd-fef2-46eb-af7e-742e1870e13c tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f0514e82670>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.155888 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ebcc5dbd-fef2-46eb-af7e-742e1870e13c tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 200 len: 344 microversion: 2.1 time: 0.051280 Dec 15 16:11:29.156548 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 382/734] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:29 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:29.968052 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:29.969204 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:29.975121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.975558 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:29.976321 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:29.976746 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:30.105945 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:30.113047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8be1893c-bcbd-4d1a-8813-e320fc0a2254 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.149071 Dec 15 16:11:30.113612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 353/735] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:29 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:30.168250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-63b7fe2d-7381-48ee-b4d9-f3febcd5144e tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141c3b80>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:30.212621 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-63b7fe2d-7381-48ee-b4d9-f3febcd5144e tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 200 len: 344 microversion: 2.1 time: 0.048404 Dec 15 16:11:30.213175 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 383/736] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:30 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:31.129978 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:31.130610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:31.136972 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:31.137422 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:31.138290 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:31.138727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:31.226003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ee77df3d-e4e6-4f7a-8823-fcd21de52b01 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141de820>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:31.272206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ee77df3d-e4e6-4f7a-8823-fcd21de52b01 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 200 len: 344 microversion: 2.1 time: 0.050217 Dec 15 16:11:31.272894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 384/737] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:31 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:11:31.275856 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:31.283871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a787fd74-fa73-47ed-9560-a674d340efb4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.157534 Dec 15 16:11:31.284425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 354/738] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:31 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:32.288221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ceca9f64-1b10-4cad-ad78-bcaf9536f8ed tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141deee0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:32.301155 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:32.302117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:32.308324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.308767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.309726 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:32.310190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:32.340552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ceca9f64-1b10-4cad-ad78-bcaf9536f8ed tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 200 len: 344 microversion: 2.1 time: 0.059506 Dec 15 16:11:32.341116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 385/739] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:32 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:32.450983 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:32.459127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6d42bbec-38c7-4282-9f53-f5d93037e8e6 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.162208 Dec 15 16:11:32.459909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 355/740] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:32 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:33.353962 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-54dd0238-a746-440f-a6fa-33a8d7d31c1e tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141c3700>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:33.385180 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-54dd0238-a746-440f-a6fa-33a8d7d31c1e tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] HTTP exception thrown: Volume 406b635a-84ab-4c69-a6c0-af261ab84d27 could not be found. Dec 15 16:11:33.385760 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-54dd0238-a746-440f-a6fa-33a8d7d31c1e tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Returning 404 to user: Volume 406b635a-84ab-4c69-a6c0-af261ab84d27 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:33.386616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-54dd0238-a746-440f-a6fa-33a8d7d31c1e tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 404 len: 109 microversion: 2.1 time: 0.037020 Dec 15 16:11:33.387180 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 386/741] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:33 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:33.400882 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-21d6a517-fb69-454e-a501-2b550dce8fd7 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f0514294040>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:33.428246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-21d6a517-fb69-454e-a501-2b550dce8fd7 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] HTTP exception thrown: Volume 406b635a-84ab-4c69-a6c0-af261ab84d27 could not be found. Dec 15 16:11:33.428833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-21d6a517-fb69-454e-a501-2b550dce8fd7 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Returning 404 to user: Volume 406b635a-84ab-4c69-a6c0-af261ab84d27 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:33.429647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-21d6a517-fb69-454e-a501-2b550dce8fd7 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 404 len: 109 microversion: 2.1 time: 0.032380 Dec 15 16:11:33.430204 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 356/742] 10.222.0.41 () {58 vars in 1247 bytes} [Wed Dec 15 16:11:33 2021] DELETE /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:33.437674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-31bad8ac-aa04-475d-9b6b-9faafd5b78a4 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Calling method '.version_select at 0x7f05141bef70>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:33.463674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-31bad8ac-aa04-475d-9b6b-9faafd5b78a4 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] HTTP exception thrown: Volume 406b635a-84ab-4c69-a6c0-af261ab84d27 could not be found. Dec 15 16:11:33.464254 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-31bad8ac-aa04-475d-9b6b-9faafd5b78a4 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] Returning 404 to user: Volume 406b635a-84ab-4c69-a6c0-af261ab84d27 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:33.465102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-31bad8ac-aa04-475d-9b6b-9faafd5b78a4 tempest-VolumesSnapshotsTestJSON-1115257886 tempest-VolumesSnapshotsTestJSON-1115257886-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27" status: 404 len: 109 microversion: 2.1 time: 0.031001 Dec 15 16:11:33.465621 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 387/743] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:11:33 2021] GET /compute/v2.1/os-volumes/406b635a-84ab-4c69-a6c0-af261ab84d27 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:33.476298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:33.477770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:33.483683 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:33.484144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:33.484929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:33.485373 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:33.633065 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:33.641306 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6df78029-a6fe-49d2-a22d-dd7dc83562aa tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.168460 Dec 15 16:11:33.651434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 357/744] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:33 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:34.659270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:34.659926 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:34.666368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:34.666832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:34.667605 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:34.668045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:34.798597 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:34.806300 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7bb88d6d-2b3a-4478-85b4-2c76eac49ddd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.151146 Dec 15 16:11:34.806863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 388/745] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:34 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:35.823840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:35.824365 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:35.831160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:35.831610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:35.832383 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:35.832818 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:35.966589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:35.974441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5fe99a12-4b5e-44c4-aa5a-9dec566d7f1e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.154329 Dec 15 16:11:35.975004 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 358/746] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:35 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:36.991538 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:36.992173 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:36.998849 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:36.999296 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:37.000201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:37.000514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:37.132041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:37.139299 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-24be4f65-71ae-40e3-84e3-e5fdeb9a90ca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.151405 Dec 15 16:11:37.139864 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 389/747] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:36 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:38.156727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:38.157326 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:38.163515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:38.163960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:38.164732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:38.165165 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:38.307421 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:38.315564 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-283ec645-919d-40a1-82e6-fd95beffdf4b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1676 microversion: 2.1 time: 0.162619 Dec 15 16:11:38.316126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 359/748] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:38 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:39.333491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:39.334492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:39.341091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.341689 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.342543 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.342979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.481260 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:39.490088 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-51ddbfd3-eed8-4ba6-9af0-196f8bac3ef0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1653 microversion: 2.1 time: 0.161021 Dec 15 16:11:39.490339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 390/749] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:39 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:39.512186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-99756348-6613-4548-95dc-3c460c68fe77 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:39.519628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-99756348-6613-4548-95dc-3c460c68fe77 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.520137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-99756348-6613-4548-95dc-3c460c68fe77 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.543367 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-99756348-6613-4548-95dc-3c460c68fe77 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Going to try to start instance {{(pid=116080) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:11:39.592550 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-99756348-6613-4548-95dc-3c460c68fe77 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action" status: 202 len: 0 microversion: 2.1 time: 0.084343 Dec 15 16:11:39.593487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 360/750] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:11:39 2021] POST /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:11:39.604084 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:39.604349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:39.611262 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.612253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.614729 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:39.616706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:39.786996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:39.795440 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-21c0838a-6a14-44c8-9701-0b96995057a8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1662 microversion: 2.1 time: 0.196636 Dec 15 16:11:39.796088 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 391/751] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:39 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1662 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:11:40.813726 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:40.814567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:40.821868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:40.821868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:40.822053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:40.822435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:40.985818 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:40.993333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-54263fce-4710-4802-93db-ab30cf016d37 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1662 microversion: 2.1 time: 0.184042 Dec 15 16:11:40.994920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 361/752] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:40 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:42.013539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:42.014736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:42.021688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:42.022007 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:42.022868 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:42.023229 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:42.176998 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:42.187411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9919ee10-252b-410f-83d3-c1d377cd40a2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1666 microversion: 2.1 time: 0.180341 Dec 15 16:11:42.188118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 392/753] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:11:42 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1666 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:51.140930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:51.141482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:51.147582 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.148166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.149008 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.149505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.180645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2520906f-6cfe-4b64-9232-e98c1d3294dd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments/12d32ac1-9064-43be-8709-9da3910a3ce6" status: 200 len: 194 microversion: 2.20 time: 0.043390 Dec 15 16:11:51.181728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 362/754] 10.222.0.41 () {60 vars in 1453 bytes} [Wed Dec 15 16:11:51 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments/12d32ac1-9064-43be-8709-9da3910a3ce6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:11:51.253583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:51.254857 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:51.260943 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.261392 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.262665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.263107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.346893 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lazy-loading 'services' on Instance uuid 635372a5-622f-42d6-9723-ae9c21ad0a24 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:11:51.429036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7a7204a4-4b60-4568-ac6d-3e9cb0a12c76 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments/12d32ac1-9064-43be-8709-9da3910a3ce6" status: 202 len: 0 microversion: 2.20 time: 0.179612 Dec 15 16:11:51.429745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 393/755] 10.222.0.41 () {60 vars in 1456 bytes} [Wed Dec 15 16:11:51 2021] DELETE /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments/12d32ac1-9064-43be-8709-9da3910a3ce6 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:11:51.443086 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:51.444123 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:51.456522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.457288 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.458469 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:51.458904 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:51.491237 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a9f63dca-9b0e-4431-aefa-0ddf2f081098 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056805 Dec 15 16:11:51.492250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 363/756] 10.222.0.41 () {60 vars in 1342 bytes} [Wed Dec 15 16:11:51 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:11:52.504460 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:52.505425 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.511453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.512070 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.512836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.513267 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.552270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-66c82bdc-b20b-411e-8846-60a7222b18a2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044080 Dec 15 16:11:52.552270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 394/757] 10.222.0.41 () {60 vars in 1342 bytes} [Wed Dec 15 16:11:52 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:11:52.603772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:52.604250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.610647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.611097 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.612060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.612658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.638445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:11:52.718282 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f4e9cafa-934e-4351-a563-26fdd15f2cb5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 204 len: 0 microversion: 2.20 time: 0.117937 Dec 15 16:11:52.718866 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 364/758] 10.222.0.41 () {60 vars in 1279 bytes} [Wed Dec 15 16:11:52 2021] DELETE /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:11:52.727139 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:52.728012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:52.734353 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.735052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.736044 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:52.736568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:52.883696 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:52.893124 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:52.895015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:52.896456 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0f973880-66bf-4bf6-9a29-980262032ba9 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.173083 Dec 15 16:11:52.897297 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 395/759] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:52 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:53.916389 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:53.917072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:53.923769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.924213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:53.924999 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:53.925422 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:54.060669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:54.068303 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:54.069788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:54.071116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bc9d7c4e-ef11-4aae-ac63-35d8e5c85362 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1722 microversion: 2.20 time: 0.159090 Dec 15 16:11:54.071675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 365/760] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:53 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:11:55.088942 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:55.089535 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:55.095886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.096330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.097107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.097547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.163264 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:55.171418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:55.173490 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:11:55.174788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-24d98eea-8133-400a-80ee-93b1ca17804d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 200 len: 1655 microversion: 2.20 time: 0.089723 Dec 15 16:11:55.175596 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 396/761] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:55 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:11:55.441804 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-0ebb2eaa-2d24-4a9c-a871-4cdaf2ee4d78 req-1c6c3a32-e758-4831-8d2f-f625534e7d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635372a5-622f-42d6-9723-ae9c21ad0a24", "name": "network-vif-deleted", "tag": "c48ddb89-1c93-427f-a926-073d58761058"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:55.446011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:11:55.446011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:11:55.468984 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-0ebb2eaa-2d24-4a9c-a871-4cdaf2ee4d78 req-1c6c3a32-e758-4831-8d2f-f625534e7d68 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:55.470138 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-0ebb2eaa-2d24-4a9c-a871-4cdaf2ee4d78 req-1c6c3a32-e758-4831-8d2f-f625534e7d68 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:55.487110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-0ebb2eaa-2d24-4a9c-a871-4cdaf2ee4d78 req-1c6c3a32-e758-4831-8d2f-f625534e7d68 service nova] Creating event network-vif-deleted:c48ddb89-1c93-427f-a926-073d58761058 for instance 635372a5-622f-42d6-9723-ae9c21ad0a24 on hv-cinder-80070 Dec 15 16:11:55.504945 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-0ebb2eaa-2d24-4a9c-a871-4cdaf2ee4d78 req-1c6c3a32-e758-4831-8d2f-f625534e7d68 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070559 Dec 15 16:11:55.508959 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 366/762] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:11:56.212358 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:56.212966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:11:56.222392 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.223062 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.226138 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:11:56.227338 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:11:56.245127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] HTTP exception thrown: Instance 635372a5-622f-42d6-9723-ae9c21ad0a24 could not be found. Dec 15 16:11:56.245919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Returning 404 to user: Instance 635372a5-622f-42d6-9723-ae9c21ad0a24 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:11:56.247374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ca183677-a149-408d-b58c-67354aeb9afb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 404 len: 111 microversion: 2.20 time: 0.040044 Dec 15 16:11:56.248099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 397/763] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:11:56 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:11:56.257248 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-911afd52-f3ff-4e19-80f6-5bb87a3b44e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '.version_select at 0x7f05142b28b0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:11:56.287447 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-911afd52-f3ff-4e19-80f6-5bb87a3b44e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626206936" status: 204 len: 0 microversion: 2.20 time: 0.033994 Dec 15 16:11:56.292902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 367/764] 10.222.0.41 () {60 vars in 1258 bytes} [Wed Dec 15 16:11:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626206936 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:11:57.193255 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'create', calling method: .version_select at 0x7f05141124c0>, body: {"keypair": {"name": "tempest-keypair-1627050039"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:11:57.210628 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:11:57.222965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for user e70e00befa3d41d0b5949f99d36c9b14 and project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:11:57.238114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [5460002b-f765-4b60-9de8-4e1523e06ece] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 16:11:58.263834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [5460002b-f765-4b60-9de8-4e1523e06ece] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40994. Dec 15 16:11:58.830629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:11:58.835813 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for user e70e00befa3d41d0b5949f99d36c9b14 and project f1f1638b13884efc82ff109ef86772d7. Resources: {'key_pairs'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:11:58.851474 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-32441f5f-03b8-4ad1-8b6d-74e5e6ce24b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.662024 Dec 15 16:11:58.852074 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 398/765] 10.222.0.41 () {62 vars in 1198 bytes} [Wed Dec 15 16:11:57 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1663 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 15 16:12:00.960839 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2033406919", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9de569e-dedf-412f-ac55-6fe163ed494a"}], "security_groups": [{"name": "tempest-securitygroup--710816512"}], "key_name": "tempest-keypair-1627050039", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:01.087610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] validate_networks() for [('b9de569e-dedf-412f-ac55-6fe163ed494a', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:01.514073 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:01.514527 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:01.514999 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:01.516830 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:01.517949 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:01.527876 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:01.528569 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:01.530301 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:01.530747 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:01.556925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for project f1f1638b13884efc82ff109ef86772d7. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:01.567438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Getting quotas for user e70e00befa3d41d0b5949f99d36c9b14 and project f1f1638b13884efc82ff109ef86772d7. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:01.584724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:01.587251 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:01.651347 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5d8180d5-fc52-49a3-bf56-99329e3d913a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.694741 Dec 15 16:12:01.653321 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 368/766] 10.222.0.41 () {62 vars in 1187 bytes} [Wed Dec 15 16:12:00 2021] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:12:01.670649 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-be3dcd08-f0f4-4f1b-ac2f-64a26971f034 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:01.671270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-be3dcd08-f0f4-4f1b-ac2f-64a26971f034 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:01.786037 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-be3dcd08-f0f4-4f1b-ac2f-64a26971f034 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:01.795289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-be3dcd08-f0f4-4f1b-ac2f-64a26971f034 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:01.797091 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-be3dcd08-f0f4-4f1b-ac2f-64a26971f034 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:01.799634 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-be3dcd08-f0f4-4f1b-ac2f-64a26971f034 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1282 microversion: 2.20 time: 0.140108 Dec 15 16:12:01.800680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 399/767] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:01 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:02.818284 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:02.818902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:02.831388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.835130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.836016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:02.836465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:02.946948 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:02.958830 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:02.960334 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:02.962229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8eec9856-97eb-4f9c-83e8-f8c88474479a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1342 microversion: 2.20 time: 0.147728 Dec 15 16:12:02.963223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 369/768] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:02 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1342 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:03.984238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:04.005854 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:04.029761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.035898 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.038140 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.040339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.410876 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:04.420648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:04.423201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:04.428581 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-df90f9b3-aae5-4bdf-a96b-7c51a9713b39 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.450569 Dec 15 16:12:04.429330 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 400/769] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:03 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:04.548038 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1800717611"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:04.549205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:04.559465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.561662 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.562735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:04.565144 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:04.998761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-735f5173-2109-4fa1-ac03-12ebd5cd6fe8 req-5e366474-29db-409b-bc6b-a9b0b9d26508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:05.001087 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:05.001087 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:12:05.014231 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-735f5173-2109-4fa1-ac03-12ebd5cd6fe8 req-5e366474-29db-409b-bc6b-a9b0b9d26508 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:05.018867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-735f5173-2109-4fa1-ac03-12ebd5cd6fe8 req-5e366474-29db-409b-bc6b-a9b0b9d26508 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:05.048704 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-735f5173-2109-4fa1-ac03-12ebd5cd6fe8 req-5e366474-29db-409b-bc6b-a9b0b9d26508 service nova] Creating event network-changed:2aa9ba55-7099-4c77-96de-51fbd5b9bd0f for instance 252a5452-6ada-4537-ac76-03d697ce6d08 on hv-cinder-80070 Dec 15 16:12:05.064622 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-735f5173-2109-4fa1-ac03-12ebd5cd6fe8 req-5e366474-29db-409b-bc6b-a9b0b9d26508 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069246 Dec 15 16:12:05.065536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 401/770] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:05.241707 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.network.security_group_api [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Removing security group 806d8c48-6851-4bc1-97e3-8d5b671c4b38 from port b63f7fb9-7756-47b1-b0b7-9773d09ed48c Dec 15 16:12:05.448954 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:05.449842 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:05.469836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:05.470323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:05.471131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:05.471560 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:06.123405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:06.143499 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:06.148896 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:06.154557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5e0435f0-06eb-4935-801d-04da170491ec tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.710393 Dec 15 16:12:06.157952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 402/771] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:05 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:06.204772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1b0c8dee-b720-4553-b9bd-5f96e7e26acd tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/action" status: 202 len: 0 microversion: 2.1 time: 1.660614 Dec 15 16:12:06.206479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 370/772] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:04 2021] POST /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/action => generated 0 bytes in 1663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:07.118651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-727669ce-c9f4-4f56-978c-25682801ad08 req-f9c5951d-81ce-4dbc-b098-28b16c624bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:07.120170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:07.120170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:12:07.139124 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-727669ce-c9f4-4f56-978c-25682801ad08 req-f9c5951d-81ce-4dbc-b098-28b16c624bf0 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.139698 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-727669ce-c9f4-4f56-978c-25682801ad08 req-f9c5951d-81ce-4dbc-b098-28b16c624bf0 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.166776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-727669ce-c9f4-4f56-978c-25682801ad08 req-f9c5951d-81ce-4dbc-b098-28b16c624bf0 service nova] Creating event network-changed:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:12:07.174629 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:07.175358 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:07.188836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-727669ce-c9f4-4f56-978c-25682801ad08 req-f9c5951d-81ce-4dbc-b098-28b16c624bf0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073463 Dec 15 16:12:07.189110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.189672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.191398 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:07.191812 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 403/773] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:07.200300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:07.679750 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:07.689185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:07.693673 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:07.702541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-049ab13a-4a56-44dc-8b58-e6d30b645225 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.532651 Dec 15 16:12:07.713175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 371/774] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:07 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:08.728632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:08.730052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:08.746713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:08.747412 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:08.749804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:08.750901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:08.988145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:09.005818 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:09.009845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:09.012140 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-29ab763c-9c7b-49b3-87bb-598bbe11cc10 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.293162 Dec 15 16:12:09.014518 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 404/775] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:08 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:09.132531 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:09.133959 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:09.143166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.144226 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.145190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.145784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.285690 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-4004199b-9915-4770-8b3a-436d4579d66a req-f722968e-4ccb-4cb3-9496-f0cab22b335f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:09.287476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:09.287476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:12:09.309767 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-4004199b-9915-4770-8b3a-436d4579d66a req-f722968e-4ccb-4cb3-9496-f0cab22b335f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.311371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-4004199b-9915-4770-8b3a-436d4579d66a req-f722968e-4ccb-4cb3-9496-f0cab22b335f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.328993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lazy-loading 'services' on Instance uuid 30dcd08b-43c4-4fe1-af20-c63e6927740f {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:12:09.383476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-4004199b-9915-4770-8b3a-436d4579d66a req-f722968e-4ccb-4cb3-9496-f0cab22b335f service nova] Creating event network-changed:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:12:09.403359 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-4004199b-9915-4770-8b3a-436d4579d66a req-f722968e-4ccb-4cb3-9496-f0cab22b335f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109371 Dec 15 16:12:09.407322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 405/776] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:09.447311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b3babecc-45ae-4b8a-b911-2d4047f78e78 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "DELETE /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments/d7453ce8-d917-418c-a271-208103f6e5d1" status: 202 len: 0 microversion: 2.1 time: 0.323718 Dec 15 16:12:09.447939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 372/777] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:12:09 2021] DELETE /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments/d7453ce8-d917-418c-a271-208103f6e5d1 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:09.457955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:09.458996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:09.472562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.473600 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.476292 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:09.476763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:09.553405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e6b737b0-18f3-4802-aabc-5ab1ab16a225 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100065 Dec 15 16:12:09.554814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 406/778] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:12:09 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:10.033069 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:10.034453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:10.045981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.048814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.049881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.052794 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.109854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-10e04b08-b26b-4cfb-9f0a-05e1a515d502 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Action: 'create', calling method: .version_select at 0x7f0514294940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1449079097"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:10.146147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-10e04b08-b26b-4cfb-9f0a-05e1a515d502 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:10.153089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-10e04b08-b26b-4cfb-9f0a-05e1a515d502 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for user b3982f969a9948ba87a9acfe6b03d697 and project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:10.334115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-10e04b08-b26b-4cfb-9f0a-05e1a515d502 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:10.336342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:10.354567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-10e04b08-b26b-4cfb-9f0a-05e1a515d502 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for user b3982f969a9948ba87a9acfe6b03d697 and project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:10.356870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:10.363100 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:10.367989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-caa755c8-5f45-446c-b55f-651a385920f8 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.339535 Dec 15 16:12:10.368738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 407/779] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:10 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:10.379203 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-10e04b08-b26b-4cfb-9f0a-05e1a515d502 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.511153 Dec 15 16:12:10.385759 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 373/780] 10.222.0.41 () {60 vars in 1157 bytes} [Wed Dec 15 16:12:09 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:10.566613 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:10.567834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:10.573941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.574419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.576888 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.577483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.633761 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-08a781bc-a239-44af-9988-84acb70c726f tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071597 Dec 15 16:12:10.639458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 408/781] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:12:10 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:10.645575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:10.646130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:10.654367 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.655428 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.657097 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:10.657844 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:10.770417 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] HTTP exception thrown: Instance 30dcd08b-43c4-4fe1-af20-c63e6927740f is not attached to volume d7453ce8-d917-418c-a271-208103f6e5d1 Dec 15 16:12:10.771014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Returning 404 to user: Instance 30dcd08b-43c4-4fe1-af20-c63e6927740f is not attached to volume d7453ce8-d917-418c-a271-208103f6e5d1 {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:12:10.772016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-03b18264-363b-4c61-a556-c561110788b5 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "DELETE /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments/d7453ce8-d917-418c-a271-208103f6e5d1" status: 404 len: 154 microversion: 2.1 time: 0.131500 Dec 15 16:12:10.773921 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 374/782] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:12:10 2021] DELETE /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f/os-volume_attachments/d7453ce8-d917-418c-a271-208103f6e5d1 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:12:11.387632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:11.388970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:11.398277 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.398788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.399762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.401822 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.564527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:11.579825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:11.581371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:11.587216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e0b349d5-0cf5-42d9-a5f6-3941e04d11bc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.203306 Dec 15 16:12:11.588473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 409/783] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:11 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:11.771183 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-abea5bda-78ad-4ef4-a797-a8113ad18875 req-7b326c89-3536-4cd7-a9c5-48bf10e56bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "name": "network-vif-plugged", "status": "completed", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:11.773900 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:11.773900 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:11.794249 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-abea5bda-78ad-4ef4-a797-a8113ad18875 req-7b326c89-3536-4cd7-a9c5-48bf10e56bfc service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:11.794709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-abea5bda-78ad-4ef4-a797-a8113ad18875 req-7b326c89-3536-4cd7-a9c5-48bf10e56bfc service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:11.822669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-abea5bda-78ad-4ef4-a797-a8113ad18875 req-7b326c89-3536-4cd7-a9c5-48bf10e56bfc service nova] Creating event network-vif-plugged:2aa9ba55-7099-4c77-96de-51fbd5b9bd0f for instance 252a5452-6ada-4537-ac76-03d697ce6d08 on hv-cinder-80070 Dec 15 16:12:11.829833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-abea5bda-78ad-4ef4-a797-a8113ad18875 req-7b326c89-3536-4cd7-a9c5-48bf10e56bfc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063564 Dec 15 16:12:11.831481 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 375/784] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:11.993628 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:11.995324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:12.005144 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.005623 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.007536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.009398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.038314 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:12:12.146885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7300e478-844c-4503-be78-6799be8465d2 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "DELETE /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 204 len: 0 microversion: 2.1 time: 0.157428 Dec 15 16:12:12.150329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 410/785] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:12:11 2021] DELETE /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:12:12.159654 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:12.160491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:12.168234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.168833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.169761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.170347 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.381564 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.389015 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-49a81d3a-ff3d-465d-a1e3-b60b37c52f1a tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1555 microversion: 2.1 time: 0.234445 Dec 15 16:12:12.389714 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 376/786] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:12 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:12.605401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:12.606563 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:12.613800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.614414 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.615290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:12.615726 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:12.766955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.775172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.776814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:12.778012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9df6a247-63b3-4b81-a6aa-7cdf6ace6cde tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1407 microversion: 2.20 time: 0.176797 Dec 15 16:12:12.778676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 411/787] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:12 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:13.418621 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:13.420713 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:13.431195 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:13.431838 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:13.451028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:13.451626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:13.594601 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:13.600441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a38fd160-5712-4f2c-a836-3f5c1549fad6 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1555 microversion: 2.1 time: 0.190445 Dec 15 16:12:13.610543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 377/788] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:13 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:13.796530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:13.797686 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:13.804013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:13.804512 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:13.805289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:13.805716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:13.953104 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:13.968651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:13.976074 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:13.977544 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-045355c6-1363-4641-b0df-e4a52ca97f09 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1598 microversion: 2.20 time: 0.184754 Dec 15 16:12:13.978465 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 412/789] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:12:13 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:12:13.995323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:13.995811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:14.002175 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.002637 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.003402 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.003833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.102034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-de835429-4283-48bf-9d8b-55fe95bf2863 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110402 Dec 15 16:12:14.102685 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 378/790] 10.222.0.41 () {60 vars in 1315 bytes} [Wed Dec 15 16:12:13 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:12:14.619213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:14.619900 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:14.626960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.627782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.629062 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:14.629647 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:14.776147 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:14.785118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cac9a96a-a0a9-4085-9188-a447b88428db tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1555 microversion: 2.1 time: 0.171135 Dec 15 16:12:14.785759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 413/791] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:14 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:15.551523 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-dbcb6da1-7fab-4630-a695-6783d04dc403 req-bf47109b-06b2-4dca-927a-066624b4a9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30dcd08b-43c4-4fe1-af20-c63e6927740f", "name": "network-vif-deleted", "tag": "b63f7fb9-7756-47b1-b0b7-9773d09ed48c"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:15.553166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:15.553166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:15.565661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-dbcb6da1-7fab-4630-a695-6783d04dc403 req-bf47109b-06b2-4dca-927a-066624b4a9e2 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.575031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-dbcb6da1-7fab-4630-a695-6783d04dc403 req-bf47109b-06b2-4dca-927a-066624b4a9e2 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.602546 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-dbcb6da1-7fab-4630-a695-6783d04dc403 req-bf47109b-06b2-4dca-927a-066624b4a9e2 service nova] Creating event network-vif-deleted:b63f7fb9-7756-47b1-b0b7-9773d09ed48c for instance 30dcd08b-43c4-4fe1-af20-c63e6927740f on hv-cinder-80070 Dec 15 16:12:15.615431 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-dbcb6da1-7fab-4630-a695-6783d04dc403 req-bf47109b-06b2-4dca-927a-066624b4a9e2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069067 Dec 15 16:12:15.616299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 379/792] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:15.632669 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:15.633626 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:15.653540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.654221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.658688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.659525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.756192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-600769e3-cec3-44c5-9aa5-098398c3ab9b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.132698 Dec 15 16:12:15.759463 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 414/793] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:15 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:15.805296 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:15.806024 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:15.812369 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.813061 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.813839 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.814286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.854486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:15.854934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:15.855383 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lazy-loading 'fault' on Instance uuid 30dcd08b-43c4-4fe1-af20-c63e6927740f {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:12:15.909281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44a537084a4e7183cc5ca792ba5260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3dc08abeae460eb69305e30b4fe62d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:15.919689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-90efb129-2483-47d5-afbd-a6836c82bc32 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 200 len: 1349 microversion: 2.1 time: 0.119701 Dec 15 16:12:15.920292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 380/794] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:15 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 1349 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:16.768401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:16.770386 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:16.777566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:16.778011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:16.778852 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:16.779286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:16.841713 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b28c6dcb-703e-4cea-8a9a-339afc74d082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.077764 Dec 15 16:12:16.844233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 415/795] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:16 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:16.936650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:16.937252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] [instance: 30dcd08b-43c4-4fe1-af20-c63e6927740f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:16.944198 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:16.944638 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:16.945399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:16.945825 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:16.958711 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] HTTP exception thrown: Instance 30dcd08b-43c4-4fe1-af20-c63e6927740f could not be found. Dec 15 16:12:16.959281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Returning 404 to user: Instance 30dcd08b-43c4-4fe1-af20-c63e6927740f could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:12:16.960068 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8be916bb-8a3d-482e-891e-9b13484a0822 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f" status: 404 len: 111 microversion: 2.1 time: 0.027083 Dec 15 16:12:16.960576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 381/796] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:16 2021] GET /compute/v2.1/servers/30dcd08b-43c4-4fe1-af20-c63e6927740f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:12:16.968824 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a8504ad6-6584-42f0-9e13-620a261da242 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] Calling method '.version_select at 0x7f05140d3d30>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:16.987252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a8504ad6-6584-42f0-9e13-620a261da242 tempest-TestMinimumBasicScenario-553983164 tempest-TestMinimumBasicScenario-553983164-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1512623372" status: 202 len: 0 microversion: 2.1 time: 0.022311 Dec 15 16:12:16.987798 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 416/797] 10.222.0.41 () {58 vars in 1271 bytes} [Wed Dec 15 16:12:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1512623372 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:17.636858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-51c2189d-44e3-49e6-a45b-28b9aba8101c req-eeb8ce10-9cc7-40e6-b32c-a3d7248d783e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:17.638382 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:17.638382 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:17.645661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-51c2189d-44e3-49e6-a45b-28b9aba8101c req-eeb8ce10-9cc7-40e6-b32c-a3d7248d783e service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.646098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-51c2189d-44e3-49e6-a45b-28b9aba8101c req-eeb8ce10-9cc7-40e6-b32c-a3d7248d783e service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.660128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-51c2189d-44e3-49e6-a45b-28b9aba8101c req-eeb8ce10-9cc7-40e6-b32c-a3d7248d783e service nova] Creating event network-changed:2aa9ba55-7099-4c77-96de-51fbd5b9bd0f for instance 252a5452-6ada-4537-ac76-03d697ce6d08 on hv-cinder-80070 Dec 15 16:12:17.665456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-51c2189d-44e3-49e6-a45b-28b9aba8101c req-eeb8ce10-9cc7-40e6-b32c-a3d7248d783e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032281 Dec 15 16:12:17.666737 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 382/798] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:17.714652 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:17.716422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:17.723282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.723728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.724515 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.724948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.753470 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-db3cfcaa-efb8-4f1f-a5b8-1a6c7d90b91a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043263 Dec 15 16:12:17.754040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 417/799] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:12:17 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:17.813262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:17.813916 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:17.820028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.820575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.821425 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.821934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.847375 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:12:17.852935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:17.853965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:17.861328 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.861907 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.862819 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.863334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.929459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ed5e2da2-d1fd-45c4-84ff-0382ff18e21f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 204 len: 0 microversion: 2.1 time: 0.119925 Dec 15 16:12:17.934691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 383/800] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:12:17 2021] DELETE /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:12:17.941067 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-63aa5cdb-15fa-4e0c-be99-d039fafa03a4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.092017 Dec 15 16:12:17.941469 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:17.942191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:17.945723 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 418/801] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:17 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:17.948463 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.948917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:17.949734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:17.950180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:18.299029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:18.306392 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-20488def-ac9a-481e-9b39-38ee3f548324 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1672 microversion: 2.1 time: 0.370136 Dec 15 16:12:18.306963 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 384/802] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:17 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:18.952144 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:18.953116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:18.959948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:18.960386 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:18.961148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:18.961574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:19.029994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7f074091-f320-474e-be2e-4ad4220e5b29 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.081700 Dec 15 16:12:19.030658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 419/803] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:18 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:19.325193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:19.325717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:19.333652 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:19.334220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:19.335441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:19.336065 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:19.466871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:19.474783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5ae3287a-d53c-4722-bd58-dcb93dc62e6d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1672 microversion: 2.1 time: 0.153335 Dec 15 16:12:19.475346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 385/804] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:19 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:20.042241 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:20.043239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:20.050614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:20.051066 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.051848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:20.052287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.129337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d58e37bf-8a7e-425d-8398-74683db2fe83 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.090988 Dec 15 16:12:20.132517 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 420/805] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:20 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:20.491768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:20.492365 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:20.499100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:20.499541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.500392 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:20.500817 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:20.922934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:20.930053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-bd8885f4-88b3-45b6-9fb7-a957f32b382a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 200 len: 1672 microversion: 2.1 time: 0.441949 Dec 15 16:12:20.930756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 386/806] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:20 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 1672 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:21.141912 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:21.143702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:21.151984 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.153441 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.154616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.155278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.215429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-349f6b9d-7729-4c54-a79e-fb9f28cfcb3e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.078249 Dec 15 16:12:21.216013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 421/807] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:21 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:21.288011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-cd30dc64-566c-4a68-b380-0cf023e0eac6 req-3f4ae44b-aa6d-4a96-972e-409c9de5193b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854116b0-a886-4d4c-84c4-092c1f46b5dc", "name": "network-vif-deleted", "tag": "ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:21.289518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:21.289518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:21.298087 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-cd30dc64-566c-4a68-b380-0cf023e0eac6 req-3f4ae44b-aa6d-4a96-972e-409c9de5193b service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.298495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-cd30dc64-566c-4a68-b380-0cf023e0eac6 req-3f4ae44b-aa6d-4a96-972e-409c9de5193b service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.311522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-cd30dc64-566c-4a68-b380-0cf023e0eac6 req-3f4ae44b-aa6d-4a96-972e-409c9de5193b service nova] Creating event network-vif-deleted:ee1c4c7d-2938-4df7-abbf-fb169f0ad0cd for instance 854116b0-a886-4d4c-84c4-092c1f46b5dc on hv-cinder-80070 Dec 15 16:12:21.317167 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-cd30dc64-566c-4a68-b380-0cf023e0eac6 req-3f4ae44b-aa6d-4a96-972e-409c9de5193b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Dec 15 16:12:21.318036 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 387/808] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:21.947790 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:21.948579 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:21.957120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.957671 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.958708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:21.959145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:21.977111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] HTTP exception thrown: Instance 854116b0-a886-4d4c-84c4-092c1f46b5dc could not be found. Dec 15 16:12:21.977720 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Returning 404 to user: Instance 854116b0-a886-4d4c-84c4-092c1f46b5dc could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:12:21.978594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4867796f-5124-4f07-9946-93f09b03348b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 404 len: 111 microversion: 2.1 time: 0.034934 Dec 15 16:12:21.979178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 422/809] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:21 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:12:21.988451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e17c1c91-504f-45d3-90df-913a26b81a1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '.version_select at 0x7f05142c81f0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:22.007797 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e17c1c91-504f-45d3-90df-913a26b81a1b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010631025" status: 202 len: 0 microversion: 2.1 time: 0.023850 Dec 15 16:12:22.008394 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 388/810] 10.222.0.41 () {58 vars in 1220 bytes} [Wed Dec 15 16:12:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010631025 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:22.227239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:22.228289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:22.235603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:22.236046 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:22.236828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:22.237257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:22.305848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-453055ea-193e-4c91-abab-15af2eb3d370 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.082586 Dec 15 16:12:22.306771 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 423/811] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:22 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:22.917775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-dc5d0121-651d-4ad6-a20a-442b720ddfb0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: .version_select at 0x7f05142488b0>, body: {"keypair": {"name": "tempest-keypair-2059644858"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:22.931936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-dc5d0121-651d-4ad6-a20a-442b720ddfb0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:22.935937 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-dc5d0121-651d-4ad6-a20a-442b720ddfb0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for user 14a01a159df049e58616233166b0a007 and project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:23.063178 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-dc5d0121-651d-4ad6-a20a-442b720ddfb0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:23.066946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-dc5d0121-651d-4ad6-a20a-442b720ddfb0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for user 14a01a159df049e58616233166b0a007 and project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'key_pairs'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:23.081867 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-dc5d0121-651d-4ad6-a20a-442b720ddfb0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.167602 Dec 15 16:12:23.082418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 389/812] 10.222.0.41 () {60 vars in 1157 bytes} [Wed Dec 15 16:12:22 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:23.318644 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:23.319670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:23.341504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:23.341975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:23.342851 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:23.343205 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:23.413031 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-13f277b5-9960-4f50-96df-2e8bbead7654 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.098362 Dec 15 16:12:23.414426 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 424/813] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:23 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:24.408526 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-946173275", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "712a2ed7-316f-482c-893d-a6ba2836f0df"}], "security_groups": [{"name": "tempest-securitygroup--258827671"}], "key_name": "tempest-keypair-2059644858", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:24.426232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:24.426232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:24.433255 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.433698 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.434519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:24.434949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:24.493636 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b344527d-9357-46b2-9bf0-e3b75170d508 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.073194 Dec 15 16:12:24.494197 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 425/814] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:24 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:25.505544 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:25.506843 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:25.513714 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:25.514178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:25.514961 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:25.515400 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:25.581845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cedb695e-734c-4150-adee-3fee247ad013 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.079949 Dec 15 16:12:25.582810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 426/815] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:25 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:26.592924 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:26.593911 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:26.600788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:26.601233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:26.602000 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:26.602465 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:26.658384 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9531f233-a564-4923-a25a-7247f35e7107 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 14 microversion: 2.20 time: 0.069343 Dec 15 16:12:26.658975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 427/816] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:26 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:27.039137 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:27.039793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:27.047287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.047737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.048515 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.048949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.072838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lazy-loading 'flavor' on Instance uuid 41639b62-dff9-4f2d-9cf2-c84c363a775f {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:12:27.147821 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d0432dc6-2b10-4726-8153-9d0fc8cf13be tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "POST /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f/action" status: 202 len: 0 microversion: 2.1 time: 0.112888 Dec 15 16:12:27.148874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 428/817] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:27 2021] POST /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:27.158767 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:27.159452 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:27.166656 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.167194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.168470 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.169657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.366708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:27.374022 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e052b955-52c6-480a-990c-a497bc1cc520 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.220872 Dec 15 16:12:27.375131 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 429/818] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:27 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:27.669820 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:27.671024 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:27.678305 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.678793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.679581 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.680013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.753729 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-81341839-8e82-44bd-ae6c-f6330ac16c60 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 1150 microversion: 2.20 time: 0.087863 Dec 15 16:12:27.754509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 430/819] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:27 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 1150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:12:28.392888 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:28.393588 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:28.400586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.401025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.401809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.402281 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.537367 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:28.544616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-00015046-ac6a-4dfe-a07c-9ed265ba9ad9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.156126 Dec 15 16:12:28.545182 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 431/820] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:28 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:28.764911 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:28.766385 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:28.772969 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.773416 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.774226 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:28.774657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:28.850736 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-843daa3c-ed0a-4431-beb7-c7e185f6663a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 11371 microversion: 2.20 time: 0.089654 Dec 15 16:12:28.851352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 432/821] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:28 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 11371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:29.564342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:29.565274 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:29.572117 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.572565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.573378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.573812 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.713434 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:29.720825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7d589473-3ba7-4f49-b7bb-1c07cfe0288f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.161860 Dec 15 16:12:29.721396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 433/822] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:29 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:29.862426 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:29.863244 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:29.869983 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.870469 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.871453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:29.871891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:29.943556 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-20ec0643-cacc-4e29-a96a-ddb025295b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 16235 microversion: 2.20 time: 0.085265 Dec 15 16:12:29.944164 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 434/823] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:29 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 16235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:30.721372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] validate_networks() for [('712a2ed7-316f-482c-893d-a6ba2836f0df', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:30.737153 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:30.737868 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:30.744960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.745410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.746221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.746658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.956329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:30.964479 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-db80696b-f6ba-4216-9d6b-fa4ffe1d2569 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.231314 Dec 15 16:12:30.965050 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 435/824] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:30 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:30.969682 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:30.970594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:30.976637 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.977087 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:30.977875 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:30.978412 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.058974 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-70cc1477-7bba-477a-b4cb-229293dbf984 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 18356 microversion: 2.20 time: 0.092475 Dec 15 16:12:31.059651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 436/825] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:30 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 18356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:31.151448 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:31.152001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:31.152478 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:31.153582 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:31.154004 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:31.166300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.166942 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.176408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.176408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.194704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:31.199789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Getting quotas for user 14a01a159df049e58616233166b0a007 and project 3e13488e748245a68c7bee06a92fb0ff. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:31.211447 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:31.213901 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:31.261270 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-654bcfe6-b033-441a-9386-c4ddb922d6fb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.857105 Dec 15 16:12:31.261911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 390/826] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:12:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 6858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:12:31.272349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9f98eed8-1fb9-4aa8-88a6-dcce9e785389 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:31.273058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9f98eed8-1fb9-4aa8-88a6-dcce9e785389 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:31.364036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9f98eed8-1fb9-4aa8-88a6-dcce9e785389 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:31.371153 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9f98eed8-1fb9-4aa8-88a6-dcce9e785389 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1237 microversion: 2.1 time: 0.102314 Dec 15 16:12:31.371307 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 437/827] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:31 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:31.982268 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:31.982793 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:31.990190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.990657 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:31.991450 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:31.991891 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.071169 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:32.072080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:32.080590 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.081045 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.081832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.082302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.160084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:32.168447 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-39509f3d-9b3d-4ce4-8269-5453a5b2ed54 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.191021 Dec 15 16:12:32.169008 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 391/828] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:31 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:32.182540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-02728235-fa6a-4bdd-a982-b2ee61b89d85 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 19342 microversion: 2.20 time: 0.115386 Dec 15 16:12:32.184769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 438/829] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:32 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 19342 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:32.388842 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:32.389938 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:32.403049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.404010 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.405044 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.405516 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.563875 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:32.573775 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4bb33417-1fd5-4643-b474-87d3f4e4ff91 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1297 microversion: 2.1 time: 0.189737 Dec 15 16:12:32.586356 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 392/830] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:32 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1297 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:33.185349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.186670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.196350 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.196743 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:33.197812 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.198298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.199275 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.199891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.208232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.208777 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.210229 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.210911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.364132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-83f4883b-4106-4806-a038-d905b2419a3c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 22072 microversion: 2.20 time: 0.172211 Dec 15 16:12:33.365546 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 393/831] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:33 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 22072 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:33.575642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:33.584507 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-63641fa7-450f-4534-952d-0737a7944bf7 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.403305 Dec 15 16:12:33.585702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 439/832] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:33.600172 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.602141 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:33.609939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.610725 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.611695 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:33.612302 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:33.981218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:33.989199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-60cd6b6d-967f-44ba-aa62-760eac35f1e7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.399274 Dec 15 16:12:33.989766 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 394/833] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:34.507387 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:34.508272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:34.515936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.516418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.517177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.517606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.590611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-9c0025c2-d1ac-4e5c-87a2-39d165b70dcb req-17292387-bf24-4f62-b08c-41a8f4973cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d873faab-122e-4bf4-b9dc-34e7fcd3aaf0", "tag": "43d41972-3fcb-46b9-9b91-ad8f8a032907"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:34.592225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:34.592225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:34.599079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-dcebe734-2822-4c2b-9f48-aafd43fccf9a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 23229 microversion: 2.20 time: 0.227060 Dec 15 16:12:34.605133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 440/834] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:34 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 23229 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:34.610935 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:34.612633 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:34.613051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-9c0025c2-d1ac-4e5c-87a2-39d165b70dcb req-17292387-bf24-4f62-b08c-41a8f4973cda service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.613609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-9c0025c2-d1ac-4e5c-87a2-39d165b70dcb req-17292387-bf24-4f62-b08c-41a8f4973cda service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.623023 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.623661 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.625495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:34.626098 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:34.652886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-9c0025c2-d1ac-4e5c-87a2-39d165b70dcb req-17292387-bf24-4f62-b08c-41a8f4973cda service nova] Creating event network-changed:43d41972-3fcb-46b9-9b91-ad8f8a032907 for instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 on hv-cinder-80070 Dec 15 16:12:34.658258 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-9c0025c2-d1ac-4e5c-87a2-39d165b70dcb req-17292387-bf24-4f62-b08c-41a8f4973cda service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071471 Dec 15 16:12:34.659150 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 395/835] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:34.834228 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:34.841891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2b4ecdbf-2fd3-447a-99b1-ee76d9a00107 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.235174 Dec 15 16:12:34.842519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 441/836] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:34 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:35.006776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:35.007449 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.013400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.013853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.014677 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.015112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.212376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:35.224744 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6d2589d9-95ac-4fd6-b42a-894e74556749 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.221776 Dec 15 16:12:35.232465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 396/837] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:35 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:35.589072 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1186604297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1449079097", "security_groups": [{"name": "tempest-secgroup-smoke-1561118706"}], "block_device_mapping_v2": [{"uuid": "5f3dc29b-7649-4b3d-a030-e51ba44752ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6547453-c061-40ed-854e-81302323e81a"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:35.614191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:35.616401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.622993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.623691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.625205 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.625841 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.723498 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-60d27e89-a92f-49dd-96fc-ef3367f2fa34 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 23805 microversion: 2.20 time: 0.115975 Dec 15 16:12:35.727576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 397/838] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:35 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 23805 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:35.775576 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] validate_networks() for [('c6547453-c061-40ed-854e-81302323e81a', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:12:35.858420 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:35.859647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:35.866755 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.867468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:35.868442 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:35.868881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.008464 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.016075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-dec9110d-6483-4a98-b729-a15312ce44e9 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.161681 Dec 15 16:12:36.016757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 398/839] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:35 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:36.240805 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:36.241414 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:36.247672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.248121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.248898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.249414 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.380286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:36.387534 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2c65ce47-f64e-40c0-9829-050151130b59 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.150328 Dec 15 16:12:36.397084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 399/840] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:36 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:36.735774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:36.736754 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:36.743345 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.743482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.744246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.744676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.745717 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:12:36.746397 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:12:36.747225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:12:36.747744 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:12:36.748217 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:12:36.770831 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.771287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.772099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:36.772529 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:36.801005 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:12:36.805225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for user b3982f969a9948ba87a9acfe6b03d697 and project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:12:36.828642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9eb44220-7410-4085-a519-93429a177f4a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 25012 microversion: 2.20 time: 0.096750 Dec 15 16:12:36.829285 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 400/841] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:36 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 25012 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:36.864738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:12:36.866940 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f3dc29b-7649-4b3d-a030-e51ba44752ff',volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:12:37.005959 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8945881e-b1f6-4388-bf93-ff10ca58ef50 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.420999 Dec 15 16:12:37.007449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 442/842] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:12:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:12:37.017483 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-18443373-a9b7-42e2-89b4-637d733c9854 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.018551 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-18443373-a9b7-42e2-89b4-637d733c9854 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.034040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.034681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.047441 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.048111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.048730 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.049189 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.084701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-18443373-a9b7-42e2-89b4-637d733c9854 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.092210 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-18443373-a9b7-42e2-89b4-637d733c9854 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1095 microversion: 2.1 time: 0.078737 Dec 15 16:12:37.101839 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 401/843] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.286639 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.300693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f6a56aa3-a24a-44c9-86e4-53fe08d7e9ff tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.271452 Dec 15 16:12:37.308727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 443/844] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.404842 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:37.405895 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.416979 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.417815 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.420369 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.422528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.782696 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:37.789484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2c5ddb8d-9ca2-4a8d-9b06-bff6fbaf0bb1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.388484 Dec 15 16:12:37.793513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 402/845] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:37 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:37.840346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:37.841357 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:37.854143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.854916 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.856810 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:37.859701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:37.967479 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-569fe67c-d12a-4cb0-9f6a-589653705ca7 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 26309 microversion: 2.20 time: 0.130517 Dec 15 16:12:37.969092 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 444/846] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:37 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 26309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:38.109789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.110528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.121042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.122965 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.124047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.125115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.203127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:38.217029 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3252dde3-9317-48d0-99df-63ade1ef2378 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1193 microversion: 2.1 time: 0.111590 Dec 15 16:12:38.228179 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 403/847] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:38.328250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.329013 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.338754 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.339264 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.348102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.348804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.588565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:38.597004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b2558d9d-b3a7-4813-ad08-2e12440aacea tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.283326 Dec 15 16:12:38.597591 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 445/848] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:38.809603 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:38.812452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.821598 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.822384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.824098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.824608 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.980483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:38.982507 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:38.989322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.989859 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:38.990944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:38.991463 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.083630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3e1a5a16-6eab-49fb-9614-1ae509c4509b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 27191 microversion: 2.20 time: 0.106897 Dec 15 16:12:39.084164 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 446/849] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:38 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 27191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:39.167139 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.175236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ee4f0666-9411-49d8-92fd-2d2209d1eb83 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.372384 Dec 15 16:12:39.176386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 404/850] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:38 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:39.238016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:39.239075 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:39.251728 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.252660 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.253751 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.254436 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.338466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.347909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-75088ec3-328c-419c-b2e2-50650019b882 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1199 microversion: 2.1 time: 0.115520 Dec 15 16:12:39.349086 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 447/851] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:39 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:39.620129 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:39.620901 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:39.628440 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.629153 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.630044 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.630688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.891675 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-27c2d2d2-77fb-4f61-8c3d-113957f787d6 req-6c4a52f0-92d3-497a-aa52-a3a74d107089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d873faab-122e-4bf4-b9dc-34e7fcd3aaf0", "name": "network-vif-plugged", "status": "completed", "tag": "43d41972-3fcb-46b9-9b91-ad8f8a032907"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:39.893615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:39.893615 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:12:39.901057 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-27c2d2d2-77fb-4f61-8c3d-113957f787d6 req-6c4a52f0-92d3-497a-aa52-a3a74d107089 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:39.901763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-27c2d2d2-77fb-4f61-8c3d-113957f787d6 req-6c4a52f0-92d3-497a-aa52-a3a74d107089 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:39.921346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-27c2d2d2-77fb-4f61-8c3d-113957f787d6 req-6c4a52f0-92d3-497a-aa52-a3a74d107089 service nova] Creating event network-vif-plugged:43d41972-3fcb-46b9-9b91-ad8f8a032907 for instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 on hv-cinder-80070 Dec 15 16:12:39.926806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-27c2d2d2-77fb-4f61-8c3d-113957f787d6 req-6c4a52f0-92d3-497a-aa52-a3a74d107089 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043480 Dec 15 16:12:39.927964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 448/852] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:39.943227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:39.957753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-74bc2edb-dfb7-4155-a7c2-c20e8bbf123c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.345476 Dec 15 16:12:39.962764 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 405/853] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:39 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:40.095965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:40.097551 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:40.104163 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.104534 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.105340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.105779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.188198 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-792f042d-79db-4804-a03a-664d7654e296 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 27821 microversion: 2.20 time: 0.096519 Dec 15 16:12:40.189608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 449/854] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:40 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 27821 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:40.192665 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:40.193647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:40.200214 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.201132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.202672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.203523 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.366412 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:40.367378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:40.379486 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.380374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.381535 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:40.382216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:40.536387 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.547309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0b6c700a-ce91-4ab6-98e6-8eca82e9854b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.358224 Dec 15 16:12:40.548555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 406/855] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:40 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:40.570592 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:40.580762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b0b63088-4cbf-420c-931d-8b23068be9c0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.219144 Dec 15 16:12:40.581506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 450/856] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:40 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:40.977742 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:40.978384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.000294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.000729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.001794 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.002987 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.115362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-bb629808-3f47-4c36-beae-c2960a2a403e req-ce2fe9b2-ea55-4a50-b0da-9951ed9ab3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82dd27b-c17d-46b9-90ba-ac10e0df5039", "tag": "ff8c60a3-47a7-4194-b028-2e81bba77d11"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:41.117774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:41.117774 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:12:41.128118 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-bb629808-3f47-4c36-beae-c2960a2a403e req-ce2fe9b2-ea55-4a50-b0da-9951ed9ab3ce service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.129109 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-bb629808-3f47-4c36-beae-c2960a2a403e req-ce2fe9b2-ea55-4a50-b0da-9951ed9ab3ce service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.145580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-bb629808-3f47-4c36-beae-c2960a2a403e req-ce2fe9b2-ea55-4a50-b0da-9951ed9ab3ce service nova] Creating event network-changed:ff8c60a3-47a7-4194-b028-2e81bba77d11 for instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 on hv-cinder-80070 Dec 15 16:12:41.153711 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-bb629808-3f47-4c36-beae-c2960a2a403e req-ce2fe9b2-ea55-4a50-b0da-9951ed9ab3ce service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045295 Dec 15 16:12:41.155965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 451/857] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:41.200672 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:41.201667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.218324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.218699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.219493 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.220165 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.318128 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b2144d93-8a42-4ac9-ae12-a483290637c3 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28189 microversion: 2.20 time: 0.120925 Dec 15 16:12:41.319167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 452/858] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:41 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28189 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:41.340443 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.351077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ff3d589e-3465-4f0a-9ae9-98a67ea11751 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1509 microversion: 2.1 time: 0.376880 Dec 15 16:12:41.351660 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 407/859] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:40 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:41.370586 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:41.372036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.380881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.381475 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.382422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.382932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.562589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-83b10bc8-cd26-436a-9ed6-4135fb65883c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "POST /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f/action" status: 202 len: 0 microversion: 2.1 time: 0.196229 Dec 15 16:12:41.567192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 453/860] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:41 2021] POST /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:41.574292 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.575144 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.576739 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.578241 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.584010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.586731 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.588169 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.588785 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.591331 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.591903 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.593166 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.597051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.770039 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.778340 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9af521ca-5b21-466b-b41c-93c4131e45ed tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1517 microversion: 2.1 time: 0.209818 Dec 15 16:12:41.779017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 454/861] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:41.786903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:41.788441 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:41.796870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.798054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.799083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:41.799933 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:41.917320 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.924782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-146677b8-e41d-45c3-a81c-489945a1192f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1362 microversion: 2.1 time: 0.358207 Dec 15 16:12:41.934378 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 408/862] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:41.959042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:41.966939 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6745ce71-4b84-4c2f-a962-c74c5593e8db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.186547 Dec 15 16:12:41.967514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 455/863] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:41 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:42.331821 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:42.333512 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.341671 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.343434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.344401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.344882 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.407941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c74169e1-0a6c-4af0-b5d1-29f49d1f67cb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28189 microversion: 2.20 time: 0.081760 Dec 15 16:12:42.409088 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 409/864] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:42 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28189 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:42.798221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.798848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.804977 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.805648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.806491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.806925 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.942214 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.943161 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.950259 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.950990 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.951781 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.952756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.953457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:42.964232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-21494ff3-c32d-4726-8e68-eb149b63201c tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.168952 Dec 15 16:12:42.965519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 456/865] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:42.984699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:42.985447 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:42.992313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.992758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:42.993537 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:42.993968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.098799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.106134 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-853dc765-135b-4514-a353-bc9d587ee2b8 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1547 microversion: 2.1 time: 0.167944 Dec 15 16:12:43.106727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 410/866] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:43.123795 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.124846 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.130700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:43.131225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.131773 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.133327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.133842 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.139494 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3c94b34e-21cc-4993-8fc1-5842f97f4dbc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.158452 Dec 15 16:12:43.140635 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 457/867] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:42 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:43.233087 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-649e93ac-651a-4beb-ad86-15f2050ee006 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113714 Dec 15 16:12:43.233959 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 411/868] 10.222.0.41 () {58 vars in 1274 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:43.419829 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:43.420985 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.427104 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.427652 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.428554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.429081 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.504945 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-28206ad5-813a-4f65-8001-af601babc47c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28480 microversion: 2.20 time: 0.088498 Dec 15 16:12:43.505693 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 458/869] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:43 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28480 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:43.778435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-6778abcd-b49e-4833-af20-dc8e4e1bd90c req-0746edea-123d-484a-af1a-d888ae603b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "name": "network-vif-unplugged", "status": "completed", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:43.780641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:43.780641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:43.789148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6778abcd-b49e-4833-af20-dc8e4e1bd90c req-0746edea-123d-484a-af1a-d888ae603b02 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.789758 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6778abcd-b49e-4833-af20-dc8e4e1bd90c req-0746edea-123d-484a-af1a-d888ae603b02 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.801624 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-6778abcd-b49e-4833-af20-dc8e4e1bd90c req-0746edea-123d-484a-af1a-d888ae603b02 service nova] Creating event network-vif-unplugged:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:12:43.806902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-6778abcd-b49e-4833-af20-dc8e4e1bd90c req-0746edea-123d-484a-af1a-d888ae603b02 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032651 Dec 15 16:12:43.807976 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 412/870] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:43.982390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:43.983088 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:43.990095 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.990751 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:43.991403 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:43.991838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.157421 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:44.158255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.164719 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.165163 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.165940 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.166396 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.228207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:44.236985 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-069fc7f0-b929-4ece-a698-7c0f77cec196 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.258568 Dec 15 16:12:44.238891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 459/871] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:43 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:44.296884 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:44.298519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.309217 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.310779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.313627 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.315222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.325401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:44.334427 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-541ece18-6cfd-41be-845b-1154c7d695f2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.181004 Dec 15 16:12:44.335402 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 413/872] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:44 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:44.406783 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-100fe092-bf19-44d2-ad09-36d13cc39ef4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.115068 Dec 15 16:12:44.411511 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 460/873] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:44 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:12:44.483004 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-c96b7588-2264-4299-9242-67e3fc32bce1 req-3aa2a735-a798-4f97-ab1c-5664ccf6d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d873faab-122e-4bf4-b9dc-34e7fcd3aaf0", "tag": "43d41972-3fcb-46b9-9b91-ad8f8a032907"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:44.484716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:44.484716 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:44.493040 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-c96b7588-2264-4299-9242-67e3fc32bce1 req-3aa2a735-a798-4f97-ab1c-5664ccf6d1ba service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.493740 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-c96b7588-2264-4299-9242-67e3fc32bce1 req-3aa2a735-a798-4f97-ab1c-5664ccf6d1ba service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.507575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-c96b7588-2264-4299-9242-67e3fc32bce1 req-3aa2a735-a798-4f97-ab1c-5664ccf6d1ba service nova] Creating event network-changed:43d41972-3fcb-46b9-9b91-ad8f8a032907 for instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 on hv-cinder-80070 Dec 15 16:12:44.513597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-c96b7588-2264-4299-9242-67e3fc32bce1 req-3aa2a735-a798-4f97-ab1c-5664ccf6d1ba service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176852 Dec 15 16:12:44.515236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 414/874] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:44.517471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:44.518464 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:44.525271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.525956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.526915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:44.527498 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:44.626002 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-42abe949-930a-44fd-85e8-41be532e998c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28648 microversion: 2.20 time: 0.113201 Dec 15 16:12:44.627148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 461/875] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:44 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28648 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:45.254619 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:45.255309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.261624 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.262075 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.262888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.263327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.352956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:45.353773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.362282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.363079 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.364020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.364546 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.408121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.416672 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fa9152df-0786-444c-935f-bf6d2b604df3 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.166110 Dec 15 16:12:45.417337 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 415/876] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:45 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:45.421981 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:45.424154 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.431032 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.431543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.432538 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.432967 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.495012 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-677b4991-c80f-4377-a6a3-016aceaa589d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.076253 Dec 15 16:12:45.496073 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 416/877] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:45 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:45.515776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:45.523357 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e2c85475-705f-4211-a616-11a6b3f67205 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.174437 Dec 15 16:12:45.524066 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 462/878] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:45 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:45.638114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:45.639148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:45.645946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.646416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.647185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:45.647616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:45.707586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c61040a3-db18-47ad-a919-46d9f439bd6b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28648 microversion: 2.20 time: 0.073389 Dec 15 16:12:45.708436 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 417/879] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:45 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28648 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:46.433289 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:46.433917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:46.441287 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.441763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.442570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.443002 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.506770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:46.507784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:46.515064 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.515529 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.516312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.516747 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.576216 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.583991 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6c0ba77b-ebf6-44b9-ac77-299fcec4f65b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.081101 Dec 15 16:12:46.587206 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 418/880] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:46 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:12:46.587361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4b299261-e3d7-4300-9e23-1fe6374ac7e1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.155101 Dec 15 16:12:46.587361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 463/881] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:46 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:46.589389 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:46.590093 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:46.597434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.597871 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.598654 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.599085 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.720028 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:46.721024 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:46.727814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.728332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.729177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:46.729676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:46.730115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:46.738442 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f3179a73-3baf-4144-84a3-1d4f19e6d2c4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.152625 Dec 15 16:12:46.739003 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 419/882] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:46 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:46.791773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-add4ed2a-cccc-4d85-8393-8748fe4fc294 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28648 microversion: 2.20 time: 0.075848 Dec 15 16:12:46.792413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 464/883] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:46 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28648 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:47.597028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:47.597028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.602695 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:47.603352 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.603596 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.603743 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.604520 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.604961 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.611275 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.611722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.612803 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.613240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.666240 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-30624c25-3814-4560-8382-592514f86851 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.074784 Dec 15 16:12:47.666985 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 420/884] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:47 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 16:12:47.754850 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.756128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:47.756818 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.762407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-52acbef8-a937-4917-b28a-b8a864538a0f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.163849 Dec 15 16:12:47.762969 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 465/885] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:47 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:47.763615 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.764057 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.764863 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.765286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.803202 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:47.804089 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:47.810490 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.810901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.812316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:47.812746 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:47.916926 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:47.925310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4def0e05-5c67-43ef-87a1-ab88557e215e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.173029 Dec 15 16:12:47.925902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 421/886] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:47 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:48.049749 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-092ab092-2efb-45ab-98a6-56da265a8ec1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 28795 microversion: 2.20 time: 0.250027 Dec 15 16:12:48.050392 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 466/887] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:47 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 28795 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:48.676867 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:48.677808 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.684598 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.685119 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.685908 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.687034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.747811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0cbfc4b7-0ff0-4a11-8556-4a509d381f76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.074311 Dec 15 16:12:48.748600 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 422/888] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:48 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:48.779779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:48.781102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.788150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.788681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.789453 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.789879 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.923456 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:48.930927 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cbbf8f28-be1d-4f7e-b277-c85feb866d93 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.155151 Dec 15 16:12:48.937752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 467/889] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:48 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:48.942665 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:48.943357 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:48.950077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.950577 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:48.951347 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:48.951781 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.060723 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:49.061880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.068449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.069284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.069723 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.070149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.089586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:49.097991 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0c0e2563-52e9-4a38-8b93-55f68b052537 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.159214 Dec 15 16:12:49.098797 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 423/890] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:48 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:49.161826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0b34a4ad-d5ad-47d5-bea9-a078c4b082eb tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 30876 microversion: 2.20 time: 0.104317 Dec 15 16:12:49.162606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 468/891] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:49 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 30876 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:49.759337 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:49.761026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.768171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.768630 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.769473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.769918 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.845927 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ac979b64-5005-40ca-bd22-d7f0143afa84 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.090129 Dec 15 16:12:49.846617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 424/892] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:49 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:49.948950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:49.950304 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:49.958816 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.959568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:49.960568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:49.961194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.098420 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:50.105738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-265d2246-0ff2-4c0f-bc82-d0ee3c8d6d39 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1575 microversion: 2.1 time: 0.161443 Dec 15 16:12:50.106324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 469/893] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:49 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:50.124623 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:50.125395 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.132008 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.132452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.133223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.133646 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.174424 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:50.176337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.182954 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.183401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.184184 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.184610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.268725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-90e6cd30-4caa-45e8-b948-29277a3adba5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 32608 microversion: 2.20 time: 0.098346 Dec 15 16:12:50.269927 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 470/894] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:50 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 32608 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:50.289173 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:50.297363 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1c118bf9-e937-4715-87be-e59d3a4993b1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.178321 Dec 15 16:12:50.298003 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 425/895] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:50 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:50.858554 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:50.859540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:50.866471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.866921 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.867705 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:50.868135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:50.940849 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5cb8c087-9320-40a9-87f1-8b7043b35dca tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.086577 Dec 15 16:12:50.944124 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 471/896] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:50 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:51.124358 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:51.125078 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.131482 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.131930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.132861 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.133303 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.270555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.278238 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-93ccb1f0-7b7c-48e7-9b25-c22c8b56276b tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1562 microversion: 2.1 time: 0.157490 Dec 15 16:12:51.279037 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 426/897] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:51 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:51.281869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:51.282972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.290171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.290842 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.291836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.292332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.313601 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:51.314236 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.320067 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.320471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.321260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.321701 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.380962 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-71b19166-bcd9-4fcc-b64b-9f2f9598f04e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 33464 microversion: 2.20 time: 0.104073 Dec 15 16:12:51.381799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 472/898] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:51 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 33464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:51.457661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:51.464907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-70954fca-4efe-4aca-b0a6-bd467c5abbe8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.154930 Dec 15 16:12:51.465473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 427/899] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:51 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:51.951843 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:51.952945 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:51.962308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.962873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:51.963734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:51.964194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.036782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-0e388f82-7ae7-46aa-b253-649166a9d24c req-25b56966-c5b5-4d2b-beb8-8fed7d60df5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82dd27b-c17d-46b9-90ba-ac10e0df5039", "name": "network-vif-plugged", "status": "completed", "tag": "ff8c60a3-47a7-4194-b028-2e81bba77d11"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:52.037219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-642a2c45-5dc3-4fde-8284-898ce739e6bf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.089603 Dec 15 16:12:52.040625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 473/900] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:51 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:52.040745 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:52.040745 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:52.047121 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-0e388f82-7ae7-46aa-b253-649166a9d24c req-25b56966-c5b5-4d2b-beb8-8fed7d60df5f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.047560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-0e388f82-7ae7-46aa-b253-649166a9d24c req-25b56966-c5b5-4d2b-beb8-8fed7d60df5f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.058484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-0e388f82-7ae7-46aa-b253-649166a9d24c req-25b56966-c5b5-4d2b-beb8-8fed7d60df5f service nova] Creating event network-vif-plugged:ff8c60a3-47a7-4194-b028-2e81bba77d11 for instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 on hv-cinder-80070 Dec 15 16:12:52.063515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-0e388f82-7ae7-46aa-b253-649166a9d24c req-25b56966-c5b5-4d2b-beb8-8fed7d60df5f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Dec 15 16:12:52.064515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 428/901] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:12:52.394407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:52.395649 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:52.402976 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.403433 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.404229 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.404667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.483159 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:52.483952 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:52.489920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.490462 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.491233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:52.491658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:52.630371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:52.637658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-017d6c01-40f0-4397-907c-58d99bcd9b5a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.158789 Dec 15 16:12:52.638244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 429/902] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:52 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:12:52.671981 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1f5736f6-5762-4a34-a40a-213c5409c823 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 34409 microversion: 2.20 time: 0.282572 Dec 15 16:12:52.672757 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 474/903] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:52 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 34409 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:53.048459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:53.049386 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:53.055887 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.056384 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.057214 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.057680 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.131316 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4ea902fb-5462-4f8c-a117-33fe1efe075a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.086856 Dec 15 16:12:53.131905 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 430/904] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:53 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:53.655514 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:53.656200 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:53.663528 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.663996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.665026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.665278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.684246 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:53.685217 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:53.692533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.692994 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.693755 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:53.694201 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:53.801238 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5d3c08a9-b9fc-4f44-9966-8134ff21db00 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 35071 microversion: 2.20 time: 0.120787 Dec 15 16:12:53.801893 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 431/905] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:53 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 35071 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:12:53.831396 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:53.838914 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fc842f6c-d1a6-4dda-9de0-ed7d5f46d4a9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1267 microversion: 2.1 time: 0.187472 Dec 15 16:12:53.839480 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 475/906] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:53 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:54.082051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-bf9e2d3c-5395-45fc-a3a7-6d1414ba3179 req-b93b94cb-3791-4f48-aaef-a8433d11e113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "name": "network-vif-plugged", "status": "completed", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:54.083511 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:54.083511 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:12:54.091325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-bf9e2d3c-5395-45fc-a3a7-6d1414ba3179 req-b93b94cb-3791-4f48-aaef-a8433d11e113 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.091764 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-bf9e2d3c-5395-45fc-a3a7-6d1414ba3179 req-b93b94cb-3791-4f48-aaef-a8433d11e113 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.103495 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-bf9e2d3c-5395-45fc-a3a7-6d1414ba3179 req-b93b94cb-3791-4f48-aaef-a8433d11e113 service nova] Creating event network-vif-plugged:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:12:54.109021 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-bf9e2d3c-5395-45fc-a3a7-6d1414ba3179 req-b93b94cb-3791-4f48-aaef-a8433d11e113 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030235 Dec 15 16:12:54.109617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 432/907] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:54.141819 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:54.142752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:54.148968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.149411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.150194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.150624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.233986 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3012ddf3-9197-4b9f-94fa-3170f62504ad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.094951 Dec 15 16:12:54.234655 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 476/908] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:54 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:54.814193 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:54.815149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:54.821170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.821622 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.822418 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.822853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.856033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:54.856806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:54.863734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.864178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.864944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:54.865375 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:54.902692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3adf8d78-0a54-4ffd-81da-9b80e1c58910 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 35997 microversion: 2.20 time: 0.093296 Dec 15 16:12:54.903514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 433/909] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:54 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 35997 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:55.004483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.011955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f18923b3-8bb4-42ac-b172-cb51b169e296 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1454 microversion: 2.1 time: 0.159944 Dec 15 16:12:55.012533 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 477/910] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:54 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:55.028890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:55.029579 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:55.037091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.037537 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.038336 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.038768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.173228 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:12:55.180515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0990ad46-11b3-4dde-a9f9-6a9c88d04ae2 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1454 microversion: 2.1 time: 0.155597 Dec 15 16:12:55.181100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 434/911] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:12:55 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:55.252135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:55.253052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:55.259293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.259751 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.260540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.260978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.324604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-164928e8-2f87-4a16-b5c9-6ff588587c20 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 14 microversion: 2.1 time: 0.081882 Dec 15 16:12:55.328291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 478/912] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:55 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:12:55.915055 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:55.915969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:55.922878 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.923324 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:55.924113 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:55.924528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.007967 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-111ed126-9e08-4e47-b7e9-c5f852ef006c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 37077 microversion: 2.20 time: 0.096683 Dec 15 16:12:56.008590 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 435/913] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:55 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 37077 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:56.336708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:56.337775 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:56.345523 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.345979 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.346796 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:56.347233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:56.425229 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-41091570-1737-42a8-8bec-2da6bb26df34 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 7546 microversion: 2.1 time: 0.092482 Dec 15 16:12:56.425884 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 479/914] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:56 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 7546 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:12:57.020449 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:57.021463 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:57.028470 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.028912 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.030279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.030721 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.113911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f05ce22b-b934-4f8d-a2ea-b3fe8aa30ded tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 38097 microversion: 2.20 time: 0.097381 Dec 15 16:12:57.118854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 436/915] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:57 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 38097 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:57.143313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-80a13776-deea-4d07-aafa-db4e12b56814 req-cccff199-7e34-4277-b078-baa99b7a345e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82dd27b-c17d-46b9-90ba-ac10e0df5039", "tag": "ff8c60a3-47a7-4194-b028-2e81bba77d11"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:57.145271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:12:57.145271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:12:57.154074 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-80a13776-deea-4d07-aafa-db4e12b56814 req-cccff199-7e34-4277-b078-baa99b7a345e service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.155213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-80a13776-deea-4d07-aafa-db4e12b56814 req-cccff199-7e34-4277-b078-baa99b7a345e service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.166589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-80a13776-deea-4d07-aafa-db4e12b56814 req-cccff199-7e34-4277-b078-baa99b7a345e service nova] Creating event network-changed:ff8c60a3-47a7-4194-b028-2e81bba77d11 for instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 on hv-cinder-80070 Dec 15 16:12:57.177203 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-80a13776-deea-4d07-aafa-db4e12b56814 req-cccff199-7e34-4277-b078-baa99b7a345e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038337 Dec 15 16:12:57.177808 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 480/916] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:12:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:57.436796 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:57.437788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:57.444849 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.445304 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.446092 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:57.446560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:57.536283 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-615ae9e0-105c-4fd4-8b21-de116ed9b6dd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 15025 microversion: 2.1 time: 0.103101 Dec 15 16:12:57.536935 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 437/917] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:57 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 15025 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:12:58.127947 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:58.128980 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:58.135350 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.135800 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.136591 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.137022 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.242111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cdafbe59-0d0b-47e1-94b4-ccea04c1031c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 38205 microversion: 2.20 time: 0.118899 Dec 15 16:12:58.242944 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 481/918] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:58 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 38205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:58.548112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:58.549096 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:58.556138 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.556587 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.557374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:58.557801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:58.644995 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b179471b-c766-48dc-8bb2-ce23120a5b96 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 17960 microversion: 2.1 time: 0.101398 Dec 15 16:12:58.645881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 438/919] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:58 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 17960 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:12:59.254302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:59.255205 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:59.262004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.262472 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.263248 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.263681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.326209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-699c7b4c-f263-451d-bbb4-bc79d509c6ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 38205 microversion: 2.20 time: 0.076019 Dec 15 16:12:59.326836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 482/920] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:12:59 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 38205 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:12:59.657783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:12:59.659016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:12:59.666266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.666768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.667553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:59.667981 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:59.753708 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-278d3474-969d-43ad-ace2-f2043afb0124 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 18170 microversion: 2.1 time: 0.101401 Dec 15 16:12:59.754410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 439/921] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:12:59 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 18170 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:00.339232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:00.340324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:00.347664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.348136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.348902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.349327 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.424298 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-002ed2d1-d71d-401c-9928-13bf8c4b2c50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 200 len: 38348 microversion: 2.20 time: 0.089466 Dec 15 16:13:00.424951 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 483/922] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:13:00 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 38348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:13:00.434953 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:00.435525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:00.443203 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.443653 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.444456 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.444886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.468419 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-6ffb09f0-84c4-4cff-8dc1-8474d32ef102 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/ips" status: 200 len: 150 microversion: 2.20 time: 0.037398 Dec 15 16:13:00.468984 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 440/923] 10.222.0.41 () {60 vars in 1288 bytes} [Wed Dec 15 16:13:00 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:00.764946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:00.766192 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:00.773843 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.774323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.775122 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:00.775610 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:00.855375 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-06effec4-08ae-4027-893d-4c9252fc252d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 20839 microversion: 2.1 time: 0.094556 Dec 15 16:13:00.855929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 484/924] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:00 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 20839 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:01.867031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:01.867846 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:01.874589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.875034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.875799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:01.876220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:01.951000 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-14723e67-78d4-4984-b757-2d094d02ee55 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 22710 microversion: 2.1 time: 0.087414 Dec 15 16:13:01.951656 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 441/925] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:01 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 22710 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:02.665094 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:02.665711 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.672487 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.672928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.673691 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.674115 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.697307 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lazy-loading 'flavor' on Instance uuid 252a5452-6ada-4537-ac76-03d697ce6d08 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:13:02.950186 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2a02046d-3fb2-4c1e-a1ee-eb6b3a67cc95 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 202 len: 0 microversion: 2.20 time: 0.289222 Dec 15 16:13:02.950818 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 485/926] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:13:02 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:13:02.959835 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:02.960733 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.966762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:02.966762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:02.968807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.969325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.970222 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.970752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.971839 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.972362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:02.973238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:02.974017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:03.057246 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d1301b11-d3f2-4c48-9876-d409db9ca541 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 23797 microversion: 2.1 time: 0.098144 Dec 15 16:13:03.057971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 486/927] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:02 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 23797 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:03.109730 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:03.117291 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:03.118806 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:03.119987 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f39f5c52-295f-4e25-a85e-add528a76924 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.164358 Dec 15 16:13:03.120539 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 442/928] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:02 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:04.069353 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:04.070370 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.077142 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.077596 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.078408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.078860 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.138330 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:04.139578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:04.146297 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.146742 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.147525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:04.147957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:04.156402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-75de3651-8cc9-478a-8b45-70af74a6669f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 24725 microversion: 2.1 time: 0.090899 Dec 15 16:13:04.160208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 487/929] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:04 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 24725 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:04.277011 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.285331 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.287102 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:04.288225 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a517270a-7308-49c1-b21b-6e6e38fd1f26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.153900 Dec 15 16:13:04.288783 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 443/930] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:04 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:05.168232 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:05.169225 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:05.176132 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.176584 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.177366 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.177805 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.260673 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9e803ee6-c9b5-4caf-94c0-0f0d04c191c1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 25858 microversion: 2.1 time: 0.096282 Dec 15 16:13:05.261368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 488/931] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:05 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 25858 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:05.306518 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:05.307122 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:05.314408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.314858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.315627 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:05.316058 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:05.441017 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.448671 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.450174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:05.451318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fd134a40-21e9-4aff-8b34-122bfcc6c386 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.148458 Dec 15 16:13:05.452526 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 444/932] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:05 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:06.273391 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:06.274457 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:06.282957 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.283406 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.284200 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.284632 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.372836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b66f477c-4723-4602-b3bc-5d651d75cf88 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 26668 microversion: 2.1 time: 0.103320 Dec 15 16:13:06.373518 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 489/933] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:06 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 26668 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:06.470438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:06.471034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:06.477260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.477703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.478509 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:06.478969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:06.607576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.615636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.617149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:06.618318 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-94f0531c-9f24-444d-917d-a04f9c028fee tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.152149 Dec 15 16:13:06.618872 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 445/934] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:06 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:07.384876 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:07.385866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:07.393351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.393804 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.394608 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.395388 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.476000 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ba5a8d06-a62a-45f6-bcf8-8c33b5b711a1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 27193 microversion: 2.1 time: 0.094967 Dec 15 16:13:07.476548 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 490/935] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:07 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 27193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:07.636934 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:07.637545 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:07.644486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.644936 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.645708 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:07.646143 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:07.770927 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:07.778647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:07.780139 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:07.781281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-30a082a8-2618-462e-8ba2-f2a79f4f2b73 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.148350 Dec 15 16:13:07.781855 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 446/936] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:07 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:08.488295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:08.489276 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:08.496098 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.496539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.497307 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.497733 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.587972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5fa28537-e0fb-4669-adae-d7e5abe42604 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 27828 microversion: 2.1 time: 0.103447 Dec 15 16:13:08.588676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 491/937] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:08 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 27828 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:08.799803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:08.800410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:08.807120 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.807573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.808353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:08.808789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:08.940157 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.947903 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.949397 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:08.950580 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c135767b-4eea-4887-bb89-daeb75b96668 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.155001 Dec 15 16:13:08.951133 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 447/938] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:08 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:09.600113 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:09.601208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:09.608195 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.608668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.609429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.609865 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.699826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a8d601a5-7439-43ad-8736-f6d90fda9405 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28126 microversion: 2.1 time: 0.103592 Dec 15 16:13:09.700491 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 492/939] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:09 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28126 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:09.969727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:09.970269 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:09.976535 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.976976 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:09.977734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:09.978180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.105232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.113331 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.114853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:10.115982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-053374fe-8b90-463f-811b-5cb58d6c2b5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.151088 Dec 15 16:13:10.116542 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 448/940] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:09 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:10.712038 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:10.713024 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:10.720066 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.720545 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:10.721352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:10.721784 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.133643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:11.134255 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:11.140454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.140900 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.141661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:11.142090 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:11.268853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.276553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.278034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:11.279220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-ad9cf406-5c19-4ee9-8b0a-27b49d165712 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.149212 Dec 15 16:13:11.279945 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 449/941] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:11 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:12.298481 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:12.299132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:12.305417 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.305861 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.306692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:12.307124 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:12.675397 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:12.682982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:12.684462 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:12.685593 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-11afbd32-e2e0-4651-9a2b-b89cf67db8fc tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.391551 Dec 15 16:13:12.686147 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 450/942] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:12 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:12.937106 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a2619b33-4dcf-44cb-b34f-394cd414baf1 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28246 microversion: 2.1 time: 2.228363 Dec 15 16:13:12.937762 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 493/943] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:10 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28246 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:13.702745 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:13.703339 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:13.709686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.710129 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.710927 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.711356 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.835240 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.843381 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.844881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:13.846014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fe779d5f-403c-481b-b218-65269a4fe9c2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.147019 Dec 15 16:13:13.846620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 451/944] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:13 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:13.948836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:13.949845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:13.958015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.958485 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:13.959261 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:13.959688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.052036 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-95d1daf8-8d56-46a9-b781-8f64814f133d tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28246 microversion: 2.1 time: 0.107018 Dec 15 16:13:14.052895 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 494/945] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:13 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:14.865024 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:14.865556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:14.872314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.872770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:14.873531 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:14.873962 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.007611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:15.015310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:15.017423 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:15.018591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-764a3f2e-cabf-4cf7-99a7-4e08d1a02973 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.157716 Dec 15 16:13:15.019149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 452/946] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:14 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:15.063918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:15.064905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:15.071679 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.072123 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.072894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:15.073322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:15.137127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5859ca15-6079-45a4-800a-6611fedd51c2 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28246 microversion: 2.1 time: 0.077511 Dec 15 16:13:15.141662 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 495/947] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:15 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:16.037338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:16.037930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:16.044168 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.044609 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.045371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.045798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.149278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:16.150316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:16.157607 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.158058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.158883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:16.159320 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:16.171812 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:16.179573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:16.181072 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:16.182250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f4eb4639-cd4a-41ff-82a9-4316da1e3b37 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.148833 Dec 15 16:13:16.182812 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 453/948] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:16 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:16.241240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9dc0fc8c-5c09-43cc-aa89-e02fc58cfea7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28459 microversion: 2.1 time: 0.095849 Dec 15 16:13:16.242249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 496/949] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:16 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28459 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:17.200084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:17.200690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:17.206980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.207435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.208267 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.208709 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.253234 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:17.254402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:17.261368 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.261881 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.262756 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:17.263276 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:17.338749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.347488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.348985 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:17.350136 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-93951fe1-9a3b-4d60-8da2-11608e2c4454 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.153794 Dec 15 16:13:17.350720 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 454/950] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:17 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:18.368589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:18.369243 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:18.377053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.377498 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.378295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:18.378729 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:18.505572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.513548 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.515060 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:18.516206 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fe376af6-57cb-4740-b5c5-137a65870abf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.151348 Dec 15 16:13:18.516764 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 455/951] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:18 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:19.534137 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:19.534755 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:19.541156 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.541599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.542401 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:19.542822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:19.671770 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:19.679626 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:19.681109 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:19.682344 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-d0629783-2d19-4202-8f91-c0769759ed47 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.151929 Dec 15 16:13:19.682902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 456/952] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:19 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:19.829793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-48b7b3d3-e7d5-445c-b057-93b8639c5483 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28537 microversion: 2.1 time: 2.579716 Dec 15 16:13:19.830666 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 497/953] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:17 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28537 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:20.700321 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:20.700920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:20.707658 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.708097 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.708865 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.709292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.841356 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:20.842392 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:20.851167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.851772 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.851888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:20.852716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:20.853385 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:20.859986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:20.861799 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:20.863135 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-21b7fa53-efb8-41e7-8a56-82ba6ae7f32c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1743 microversion: 2.20 time: 0.166385 Dec 15 16:13:20.863890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 457/954] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:20 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:20.946958 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-936900b4-1a34-4538-849d-f44958b5a41e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28705 microversion: 2.1 time: 0.109553 Dec 15 16:13:20.947826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 498/955] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:20 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28705 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:21.881872 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:21.882459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:21.888788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.889232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.889998 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.890452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.959619 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:21.961442 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:21.975864 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.976319 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:21.977253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:21.977776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:22.036617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.044281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.045768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:22.046938 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-68e0af54-e124-47bb-b9b1-992058ca3635 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1743 microversion: 2.20 time: 0.168876 Dec 15 16:13:22.048650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 458/956] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:21 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:22.067941 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3fe335ec-4fd7-48fb-a84d-c7335f593f33 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28705 microversion: 2.1 time: 0.112234 Dec 15 16:13:22.068833 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 499/957] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:21 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28705 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:23.068303 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:23.068879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.080759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:23.082869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:23.091100 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.091989 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.093706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.095806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.096507 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.099680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.100748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:23.101288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:23.200034 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9854c6dc-1513-468f-ba68-7ba14a3045eb tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28705 microversion: 2.1 time: 0.123522 Dec 15 16:13:23.201367 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 500/958] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:23 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28705 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:23.282228 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.291221 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.293131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:23.294433 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2cb85b0f-9670-4e1b-a55f-1dda0e58e912 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.231963 Dec 15 16:13:23.295218 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 459/959] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:23 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:24.217001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:24.218051 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:24.227275 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.227644 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.228452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.228875 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.319094 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5b6190fb-fa43-4799-adb2-39106bd16ccf tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28705 microversion: 2.1 time: 0.105761 Dec 15 16:13:24.321211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 460/960] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:24 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28705 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:24.329499 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:24.332711 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:24.349081 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.349590 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.350437 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.350888 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.369281 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-fdd9eb5d-16d2-43ba-8f1f-5fdb20c8ed41 req-5e072d65-ed6d-43da-a1a4-8335848e2aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "name": "network-vif-plugged", "status": "completed", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:24.371099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:24.371099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:13:24.379599 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-fdd9eb5d-16d2-43ba-8f1f-5fdb20c8ed41 req-5e072d65-ed6d-43da-a1a4-8335848e2aea service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:24.380251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-fdd9eb5d-16d2-43ba-8f1f-5fdb20c8ed41 req-5e072d65-ed6d-43da-a1a4-8335848e2aea service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:24.391190 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-fdd9eb5d-16d2-43ba-8f1f-5fdb20c8ed41 req-5e072d65-ed6d-43da-a1a4-8335848e2aea service nova] Creating event network-vif-plugged:2aa9ba55-7099-4c77-96de-51fbd5b9bd0f for instance 252a5452-6ada-4537-ac76-03d697ce6d08 on hv-cinder-80070 Dec 15 16:13:24.397257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-fdd9eb5d-16d2-43ba-8f1f-5fdb20c8ed41 req-5e072d65-ed6d-43da-a1a4-8335848e2aea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249640 Dec 15 16:13:24.397863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 501/961] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:24.514194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:24.525320 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:24.527295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:24.528766 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-797bba3b-f0b4-46ce-917a-efb1937144de tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.206207 Dec 15 16:13:24.529328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 461/962] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:24 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:25.332156 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:25.333339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:25.340176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.340702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.341959 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.342472 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.427089 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-40944e3a-cb42-4eab-9086-5bc7a6492d8e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 28705 microversion: 2.1 time: 0.099217 Dec 15 16:13:25.428440 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 502/963] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:25 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 28705 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:25.547513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:25.548118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:25.554857 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.555445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.556457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:25.556919 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:25.719910 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.728667 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.730196 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:25.732105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-00caea76-7304-4db5-93d1-a756c5e5b05c tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.188356 Dec 15 16:13:25.732877 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 462/964] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:25 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:26.440400 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:26.442295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.449418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.449876 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.450719 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.451476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.544572 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-73bbed1f-0cd6-4900-8377-1010e350fd7a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 29489 microversion: 2.1 time: 0.108122 Dec 15 16:13:26.548673 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 503/965] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:26 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 29489 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:26.751624 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:26.752927 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:26.759108 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.759812 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.760821 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:26.761206 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:26.912220 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.922519 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.924700 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:26.926171 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-398a6072-2a38-478a-a61b-93c535a0272f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.179107 Dec 15 16:13:26.937136 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 463/966] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:26 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:27.560836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:27.563016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:27.570107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.570987 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.571837 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.572404 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.655528 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b34b5d27-cae1-4148-b63b-715421f9ca06 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 31182 microversion: 2.1 time: 0.098657 Dec 15 16:13:27.657070 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 504/967] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:27 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 31182 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:27.946958 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:27.948227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:27.955095 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.955561 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:27.956332 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:27.956757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.110473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.121333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.122861 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:28.124043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8a4ea93f-7d0d-43a1-8ce0-dbd3deb8f5e5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.181854 Dec 15 16:13:28.124599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 464/968] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:27 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:28.669224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:28.670361 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:28.691758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.702443 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.704352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:28.705021 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:28.798306 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-bc3bc28d-337a-4e16-bc52-5db5f1f6b3fd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 32691 microversion: 2.1 time: 0.132899 Dec 15 16:13:28.800523 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 505/969] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:28 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 32691 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:29.142416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:29.143635 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:29.152765 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.153529 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.154597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.155142 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.394501 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:29.408728 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:29.411149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:29.412894 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0ad98ff6-a767-4df3-9b3a-f6138231d58b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.274198 Dec 15 16:13:29.413987 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 465/970] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:29 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:29.811317 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:29.812293 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:29.825521 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.826278 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.827460 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:29.829496 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:29.929742 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-63bf9207-b0b2-483c-9b87-1a4b00501895 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 33527 microversion: 2.1 time: 0.123089 Dec 15 16:13:29.931272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 506/971] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:29 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 33527 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:30.432537 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:30.433834 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:30.440490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.440930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.441710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.442132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.604517 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.612526 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.617930 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:30.619149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-53bdf6c4-ba7b-40ec-b29a-fd814ca0f86e tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.190971 Dec 15 16:13:30.625533 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 466/972] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:30 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:30.944265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:30.945529 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:30.953952 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.954447 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:30.955238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:30.955667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.035199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b6efcbaf-8b0d-499e-9a1e-b943fb334546 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 34131 microversion: 2.1 time: 0.094476 Dec 15 16:13:31.036844 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 507/973] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:30 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 34131 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:31.638367 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:31.639089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:31.645691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.646396 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.646982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:31.647417 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:31.791679 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.801017 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.802580 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:31.803865 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c167ce54-a3e1-4dc0-a843-1100e3481f50 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1738 microversion: 2.20 time: 0.169338 Dec 15 16:13:31.814735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 467/974] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:31 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:32.048049 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:32.049102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:32.056204 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.056634 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.057429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.057873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.146727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fd9ed01a-d728-452e-a643-eb29ba90857e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 34934 microversion: 2.1 time: 0.103210 Dec 15 16:13:32.147373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 508/975] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:32 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 34934 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:32.821989 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:32.822528 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:32.828819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.829272 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:32.830057 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:32.830524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.016443 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.024504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.026031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:33.027235 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a98c232f-398d-4c79-8f9c-e35b75ffd501 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1720 microversion: 2.20 time: 0.209039 Dec 15 16:13:33.027798 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 468/976] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:32 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:33.159323 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:33.160603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:33.168296 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.168747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.169544 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:33.169978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:33.247883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-81837a8a-4590-4d22-9095-0a8fd30e0117 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 35775 microversion: 2.1 time: 0.092966 Dec 15 16:13:33.248532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 509/977] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:33 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 35775 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:34.046084 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:34.046719 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:34.053070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.053546 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.054364 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.054803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.187959 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.195580 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.197078 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:34.198311 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-60044d12-dbd8-4ce3-b134-0746b3778dd0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1720 microversion: 2.20 time: 0.155869 Dec 15 16:13:34.198874 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 469/978] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:34 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:34.259924 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:34.260918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:34.267832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.268284 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.269065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:34.269504 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:34.352310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-99b0f868-64ea-40b8-94d8-f3ab76a4c353 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 36809 microversion: 2.1 time: 0.096139 Dec 15 16:13:34.352874 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 510/979] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:34 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 36809 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:35.216309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:35.216904 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.223237 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.223682 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.224446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.224869 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.352462 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.360561 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.362055 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:35.363227 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-30fb32bb-c274-49b1-83fa-3beb818a7c66 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1723 microversion: 2.20 time: 0.150698 Dec 15 16:13:35.363787 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 470/980] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:35 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:35.364339 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:35.365332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.372263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.372831 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.373614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.374050 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.380564 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1472265-2434-4e45-bf00-b15fd378d4ad"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:35.381669 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.387612 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.388133 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.388922 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.389358 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.464012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e2fe2e50-05f5-4aa0-8f77-9471013fc753 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 37885 microversion: 2.1 time: 0.103698 Dec 15 16:13:35.465227 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 511/981] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:35 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 37885 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:35.654899 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-efdbe2cb-d46a-4720-9dd7-dc78ce0e6e8f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277971 Dec 15 16:13:35.655505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 471/982] 10.222.0.41 () {62 vars in 1363 bytes} [Wed Dec 15 16:13:35 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:35.770488 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:35.771058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:35.777793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.778329 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.779099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:35.779527 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:35.988008 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-04e615a9-d425-4d6a-a446-d383c8731938 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-volume_attachments/e1472265-2434-4e45-bf00-b15fd378d4ad" status: 202 len: 0 microversion: 2.20 time: 0.222205 Dec 15 16:13:35.988637 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 512/983] 10.222.0.41 () {60 vars in 1456 bytes} [Wed Dec 15 16:13:35 2021] DELETE /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-volume_attachments/e1472265-2434-4e45-bf00-b15fd378d4ad => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:13:36.043126 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:36.043692 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:36.050064 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.050980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.051509 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.052655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.111432 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-2ba7a0eb-a614-44ed-9476-65f64d49fd85 req-e79a20b8-f488-4134-a0b3-d040e6e6a2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "name": "network-vif-unplugged", "status": "completed", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:36.113773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:36.113773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:13:36.124199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-2ba7a0eb-a614-44ed-9476-65f64d49fd85 req-e79a20b8-f488-4134-a0b3-d040e6e6a2ce service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.125196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-2ba7a0eb-a614-44ed-9476-65f64d49fd85 req-e79a20b8-f488-4134-a0b3-d040e6e6a2ce service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.137233 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.compute.server_external_events [req-2ba7a0eb-a614-44ed-9476-65f64d49fd85 req-e79a20b8-f488-4134-a0b3-d040e6e6a2ce service nova] Unable to find a host for instance 252a5452-6ada-4537-ac76-03d697ce6d08. Dropping event network-vif-unplugged {{(pid=116081) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 16:13:36.138356 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-2ba7a0eb-a614-44ed-9476-65f64d49fd85 req-e79a20b8-f488-4134-a0b3-d040e6e6a2ce service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031215 Dec 15 16:13:36.139291 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 513/984] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 16:13:36.147568 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-eaa8851a-f8c5-4498-bfa9-3a55e10893a5 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action" status: 202 len: 0 microversion: 2.20 time: 0.108140 Dec 15 16:13:36.148364 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 472/985] 10.222.0.41 () {62 vars in 1318 bytes} [Wed Dec 15 16:13:36 2021] POST /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:13:36.160016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:36.160238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:36.165975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.166458 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.167241 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.167670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.311513 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:36.319557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:36.321150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:36.322450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a1f54953-1e57-427c-947a-162ee7c6d769 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1671 microversion: 2.20 time: 0.167269 Dec 15 16:13:36.323086 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 514/986] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:36 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:36.476908 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:36.477904 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:36.483752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.484202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.484978 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:36.485419 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:36.566252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-66fcbfa3-6328-4af9-be89-a989177acac4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 38231 microversion: 2.1 time: 0.093071 Dec 15 16:13:36.566599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 473/987] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:36 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 38231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:37.340902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:37.341672 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:37.348167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.348618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.349409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.349847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.482221 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.490752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.492277 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:37.493450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d26689d6-b727-4d05-8999-ae80aaf78c33 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.156608 Dec 15 16:13:37.494018 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 515/988] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:37 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:37.577362 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:37.578430 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:37.585525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.585980 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.586806 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:37.587276 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:37.656152 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-054839ea-f376-4669-9a3e-923505aca980 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 38231 microversion: 2.1 time: 0.082665 Dec 15 16:13:37.661091 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 474/989] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:37 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 38231 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:38.511908 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:38.514267 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:38.520331 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.520782 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.521571 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.522001 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.668929 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:38.670024 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:38.684491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.685042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.685867 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:38.686339 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:38.699371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.709732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.711409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:38.712575 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cd721c6e-d58a-4259-8aca-9264613a388f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.204401 Dec 15 16:13:38.713311 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 516/990] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:38 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:39.731732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:39.732594 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:39.739725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.740333 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.741263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:39.741700 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:39.880559 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.888505 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.890020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:39.891224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8db1150c-39f7-4c4f-947c-e1f2f5eff4ba tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.163262 Dec 15 16:13:39.891787 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 517/991] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:39 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:40.908669 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:40.909344 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:40.915970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.916421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:40.917217 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:40.917657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:41.055583 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.064651 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.066251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:41.067447 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-cf0c13a0-bbb8-4319-8328-b7b3e5be0082 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.162549 Dec 15 16:13:41.068006 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 518/992] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:40 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:42.086394 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:42.087227 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:42.093434 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.094427 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.097206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:42.097648 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:42.233011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:42.240883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:42.242407 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:42.243564 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a184e940-76e6-4e45-a3ae-1757d2c4f31b tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.161402 Dec 15 16:13:42.244310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 519/993] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:42 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:43.262314 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:43.262985 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:43.270052 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:43.270609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.271468 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:43.271970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:43.407799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.416199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.417745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:43.418869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2b7100c1-1784-4f76-9be0-2d09dcb07ea6 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.160368 Dec 15 16:13:43.419426 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 520/994] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:43 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:44.437806 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:44.438731 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:44.445373 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.445851 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.446639 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:44.447058 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:44.594775 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.602642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.604263 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:44.605419 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-944908be-3382-4399-8fd9-9b81a299991f tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.171465 Dec 15 16:13:44.605980 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 521/995] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:44 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:45.624259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:45.624953 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:45.631724 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:45.632165 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.632946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:45.633372 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:45.766643 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.774729 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.776239 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:45.777429 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fadbf165-0399-4abf-9abc-2f7f0a759de0 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.157093 Dec 15 16:13:45.777992 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 522/996] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:45 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:46.795964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:46.796732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:46.803640 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.804084 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.804872 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:46.805309 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:46.944252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.953108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.954689 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:46.955846 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-794cd174-23ad-4561-ada7-7d7c3c696d26 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.163872 Dec 15 16:13:46.956395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 523/997] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:46 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:47.973918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:47.974650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:47.981582 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.982237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:47.983120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:47.983666 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.115870 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:48.123784 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:48.125776 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:48.126965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b78b4ee0-fb3a-40b4-836d-f82b22b2bd48 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.156884 Dec 15 16:13:48.127530 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 524/998] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:47 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:48.782305 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b8057c11-b61c-4f65-a40e-875dffab71d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action" status: 200 len: 38360 microversion: 2.1 time: 10.117374 Dec 15 16:13:48.783459 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 475/999] 10.222.0.41 () {60 vars in 1277 bytes} [Wed Dec 15 16:13:38 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/action => generated 38360 bytes in 10120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:13:48.793207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:48.793747 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:48.800415 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.800860 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.801624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:48.802056 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:48.824450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a4379cf3-9409-4143-af62-8ad82a34ca35 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/ips" status: 200 len: 145 microversion: 2.1 time: 0.034776 Dec 15 16:13:48.824943 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 525/1000] 10.222.0.41 () {58 vars in 1247 bytes} [Wed Dec 15 16:13:48 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:49.146055 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:49.146831 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:49.153606 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.154053 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.154851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:49.155286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:49.286294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.295098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.296577 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:49.297801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4a02b1f5-6c8c-440a-8cf0-c89d8bcb0f5a tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.156690 Dec 15 16:13:49.298388 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 476/1001] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:49 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:50.117242 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91883ea6-77b3-424f-98e7-9034a2841ab7"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:50.118390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.124660 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.125104 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.125876 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.126347 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.315771 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:50.316364 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:50.323145 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.323543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.324333 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:50.324777 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:50.344135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6cba0a5c-f897-4853-a16b-85995382509e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.230464 Dec 15 16:13:50.344758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 526/1002] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:50 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments => generated 194 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:50.468446 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.476650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.478132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:50.479312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b11c09d6-8728-4c31-87af-bbe20369c80d tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.167181 Dec 15 16:13:50.479884 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 477/1003] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:50 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:13:51.498234 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:51.498927 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:51.504990 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.505435 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.506227 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:51.506664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:51.672283 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.681231 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.682745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:51.683955 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0197d219-de38-439a-9699-b7899043bacd tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.190234 Dec 15 16:13:51.684532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 527/1004] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:51 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:52.702625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:52.703232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:52.710186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.710591 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.711366 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:52.711802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:52.841273 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.848907 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.850427 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:52.851573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1ea6fe69-35a4-4151-8df2-1635f79a1483 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.152614 Dec 15 16:13:52.852116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 478/1005] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:52 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:53.869090 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:53.869606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:53.875970 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.876901 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:53.877685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:53.878121 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:54.010885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.019296 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.020779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:54.021918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-01904ac4-9b96-4aaf-9095-09aee698f3e4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.156728 Dec 15 16:13:54.022508 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 528/1006] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:53 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:54.257703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-7571ca93-4dce-4293-b7a9-680d19029d46 req-926ed328-a7ba-442f-bbf0-b4def8d1d82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "name": "network-vif-plugged", "status": "completed", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:54.259286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:54.259286 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:13:54.267710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-7571ca93-4dce-4293-b7a9-680d19029d46 req-926ed328-a7ba-442f-bbf0-b4def8d1d82d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:54.268317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-7571ca93-4dce-4293-b7a9-680d19029d46 req-926ed328-a7ba-442f-bbf0-b4def8d1d82d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:54.280188 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-7571ca93-4dce-4293-b7a9-680d19029d46 req-926ed328-a7ba-442f-bbf0-b4def8d1d82d service nova] Creating event network-vif-plugged:2aa9ba55-7099-4c77-96de-51fbd5b9bd0f for instance 252a5452-6ada-4537-ac76-03d697ce6d08 on hv-cinder-80070 Dec 15 16:13:54.285605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-7571ca93-4dce-4293-b7a9-680d19029d46 req-926ed328-a7ba-442f-bbf0-b4def8d1d82d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031260 Dec 15 16:13:54.286216 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 479/1007] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:13:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:55.039926 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:55.040545 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:55.046909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.047362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.048145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:55.048609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:55.174277 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.182065 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.183680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:55.184771 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-85a423f6-3caa-4953-bbad-cbfc944c3ae4 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1729 microversion: 2.20 time: 0.148604 Dec 15 16:13:55.185325 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 529/1008] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:55 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:56.203138 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:56.203847 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:56.210256 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.210703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.211461 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:56.211886 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:56.346724 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.354421 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.355911 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:13:56.357070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8233a6ee-33b3-4b84-9ac9-3e6409bf4024 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1716 microversion: 2.20 time: 0.157996 Dec 15 16:13:56.357620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 480/1009] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:13:56 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:13:57.797026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:57.797931 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:57.804893 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.805342 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.806115 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.806573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.834643 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9e1febad-4689-4ede-b532-1df43e8eb92a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 Dec 15 16:13:57.835126 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 530/1010] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:13:57 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:57.844553 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:57.845043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:57.851751 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.852202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.852972 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:57.853405 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:57.881186 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f050acab-2ec2-418d-a36c-2642ab9ad89a tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/91883ea6-77b3-424f-98e7-9034a2841ab7" status: 200 len: 194 microversion: 2.1 time: 0.040364 Dec 15 16:13:57.881741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 481/1011] 10.222.0.41 () {58 vars in 1412 bytes} [Wed Dec 15 16:13:57 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/91883ea6-77b3-424f-98e7-9034a2841ab7 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:59.170915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88490dc8-947f-4ffb-bb93-47a9affa59c5"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:59.171972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:13:59.178188 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.178650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.179421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:13:59.179850 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:13:59.411071 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ad622b1f-8069-49cd-a666-49e37cbd0601 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243675 Dec 15 16:13:59.411701 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 531/1012] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:13:59 2021] POST /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:06.857733 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:06.858659 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:06.865481 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:06.865920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.866921 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:06.867628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:06.898202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-66d80f68-368d-4cb9-bc7c-4ffc5799b7c7 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044110 Dec 15 16:14:06.898781 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 482/1013] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:06 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:07.134135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.134735 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.140971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.141416 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.142283 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.142646 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.171547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-128bef67-481c-4fb7-b881-01fecc159b76 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/91883ea6-77b3-424f-98e7-9034a2841ab7" status: 200 len: 194 microversion: 2.1 time: 0.042076 Dec 15 16:14:07.172114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 532/1014] 10.222.0.41 () {58 vars in 1412 bytes} [Wed Dec 15 16:14:07 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/91883ea6-77b3-424f-98e7-9034a2841ab7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:07.181488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.181974 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:07.187810 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.188252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.189020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:07.189451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:07.264878 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lazy-loading 'services' on Instance uuid d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:07.332342 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-29292625-4948-4821-bead-d0c252b51dad tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/91883ea6-77b3-424f-98e7-9034a2841ab7" status: 202 len: 0 microversion: 2.1 time: 0.154395 Dec 15 16:14:07.332925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 483/1015] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:14:07 2021] DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/91883ea6-77b3-424f-98e7-9034a2841ab7 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:08.436362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:08.436869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:08.443128 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.443574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.444349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.444786 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.473619 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2994e8e5-68f1-4764-bf65-2bd923e0d2a5 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/88490dc8-947f-4ffb-bb93-47a9affa59c5" status: 200 len: 194 microversion: 2.1 time: 0.041019 Dec 15 16:14:08.474215 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 533/1016] 10.222.0.41 () {58 vars in 1412 bytes} [Wed Dec 15 16:14:08 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/88490dc8-947f-4ffb-bb93-47a9affa59c5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:08.484703 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:08.485316 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:08.491711 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.492158 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.492962 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:08.493395 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:08.569774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lazy-loading 'services' on Instance uuid d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:08.636697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-80739ade-ea72-4e0a-997d-2acb6060ee13 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/88490dc8-947f-4ffb-bb93-47a9affa59c5" status: 202 len: 0 microversion: 2.1 time: 0.156350 Dec 15 16:14:08.637300 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 484/1017] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:14:08 2021] DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments/88490dc8-947f-4ffb-bb93-47a9affa59c5 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:09.787947 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.788963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:09.795645 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.796119 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.796863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.797383 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.825301 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7b037ba6-854d-4dcf-88b4-eb1e07f7767f tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042129 Dec 15 16:14:09.825773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 534/1018] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:09 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:14:09.922693 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.923757 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:09.929710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.930173 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.930959 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:09.931393 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:09.959909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8d1c9387-b37a-4402-9371-4631fb0e568e tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041760 Dec 15 16:14:09.960453 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 485/1019] 10.222.0.41 () {58 vars in 1301 bytes} [Wed Dec 15 16:14:09 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:14:10.012918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:10.013408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:10.019282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.019732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.020508 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.020950 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.044867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:10.118506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-260a56c2-7dd2-49aa-9099-31fa7de7bfbc tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 204 len: 0 microversion: 2.1 time: 0.108680 Dec 15 16:14:10.119207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 535/1020] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:10 2021] DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:10.127434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:10.128710 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:10.134522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.134969 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.135738 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:10.136168 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:10.263796 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:10.271187 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8de0d581-6b8d-435a-9077-7d746dc9bc0b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1672 microversion: 2.1 time: 0.147430 Dec 15 16:14:10.271756 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 486/1021] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:10 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:11.288995 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:11.289688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:11.295965 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.296412 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.297187 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:11.297624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:11.428678 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:11.437732 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f31e9a93-302e-49ff-85fc-b428fccf91d4 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1672 microversion: 2.1 time: 0.152086 Dec 15 16:14:11.438167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 536/1022] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:11 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:12.454077 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:12.454686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:12.461712 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.462167 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.462943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.463370 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.541493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a01a159df049e58616233166b0a007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e13488e748245a68c7bee06a92fb0ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:12.558288 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-195adb7e-2a81-47ba-a90b-31faccab3a47 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 200 len: 1605 microversion: 2.1 time: 0.105947 Dec 15 16:14:12.558288 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 487/1023] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:12 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 1605 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:12.876341 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-ae45338f-20d1-4911-9057-12093237ebf8 req-4594cc2f-02a1-4ac0-8129-d765acd41af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d873faab-122e-4bf4-b9dc-34e7fcd3aaf0", "name": "network-vif-deleted", "tag": "43d41972-3fcb-46b9-9b91-ad8f8a032907"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:12.879378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:12.879378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:14:12.887600 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-ae45338f-20d1-4911-9057-12093237ebf8 req-4594cc2f-02a1-4ac0-8129-d765acd41af9 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:12.888390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-ae45338f-20d1-4911-9057-12093237ebf8 req-4594cc2f-02a1-4ac0-8129-d765acd41af9 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:12.903222 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-ae45338f-20d1-4911-9057-12093237ebf8 req-4594cc2f-02a1-4ac0-8129-d765acd41af9 service nova] Creating event network-vif-deleted:43d41972-3fcb-46b9-9b91-ad8f8a032907 for instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 on hv-cinder-80070 Dec 15 16:14:12.913783 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-ae45338f-20d1-4911-9057-12093237ebf8 req-4594cc2f-02a1-4ac0-8129-d765acd41af9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111477 Dec 15 16:14:12.915042 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 537/1024] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:13.573909 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:13.574551 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:13.581194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.581651 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.582465 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:13.582898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:13.597488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] HTTP exception thrown: Instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 could not be found. Dec 15 16:14:13.598199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Returning 404 to user: Instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:13.599105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-871d20db-ee6a-4f38-a719-74cb44684ed0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 404 len: 111 microversion: 2.1 time: 0.029072 Dec 15 16:14:13.599671 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 488/1025] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:13 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:13.608430 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6f19e454-70b1-4e9f-86dc-190941c80613 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '.version_select at 0x7f0514221820>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:13.626827 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6f19e454-70b1-4e9f-86dc-190941c80613 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059644858" status: 202 len: 0 microversion: 2.1 time: 0.022313 Dec 15 16:14:13.627609 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 538/1026] 10.222.0.41 () {58 vars in 1220 bytes} [Wed Dec 15 16:14:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059644858 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:16.478584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:16.479073 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:16.485160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.485596 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.486393 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.486822 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.500202 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] HTTP exception thrown: Instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 could not be found. Dec 15 16:14:16.500767 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Returning 404 to user: Instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:16.501560 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e5ac1fb6-bcec-42c9-9c45-a56c904bb496 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 404 len: 111 microversion: 2.1 time: 0.026577 Dec 15 16:14:16.502074 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 489/1027] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:16 2021] DELETE /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:16.510044 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:16.510789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: d873faab-122e-4bf4-b9dc-34e7fcd3aaf0] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:16.516725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.517167 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.517932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:16.518392 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:16.531153 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] HTTP exception thrown: Instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 could not be found. Dec 15 16:14:16.531725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Returning 404 to user: Instance d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:16.532519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2e145564-6028-4c66-8bdb-604f1cd898a0 tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0" status: 404 len: 111 microversion: 2.1 time: 0.026572 Dec 15 16:14:16.533030 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 539/1028] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:16 2021] GET /compute/v2.1/servers/d873faab-122e-4bf4-b9dc-34e7fcd3aaf0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:17.655428 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:17.655937 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:17.662454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.662903 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.663675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.664110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.677590 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] HTTP exception thrown: Instance 854116b0-a886-4d4c-84c4-092c1f46b5dc could not be found. Dec 15 16:14:17.678258 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Returning 404 to user: Instance 854116b0-a886-4d4c-84c4-092c1f46b5dc could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:17.679058 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-974ffe44-520e-469f-b79c-650ee9c75afd tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "DELETE /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 404 len: 111 microversion: 2.1 time: 0.027302 Dec 15 16:14:17.679575 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 490/1029] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:17 2021] DELETE /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:17.687196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:17.687799 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] [instance: 854116b0-a886-4d4c-84c4-092c1f46b5dc] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:17.694709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.695166 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.695919 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:17.696346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:17.709212 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] HTTP exception thrown: Instance 854116b0-a886-4d4c-84c4-092c1f46b5dc could not be found. Dec 15 16:14:17.709779 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] Returning 404 to user: Instance 854116b0-a886-4d4c-84c4-092c1f46b5dc could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:17.710604 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2566929a-f928-4c39-b73a-1369b510182b tempest-AttachVolumeTestJSON-1951317250 tempest-AttachVolumeTestJSON-1951317250-project] 10.222.0.41 "GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc" status: 404 len: 111 microversion: 2.1 time: 0.027174 Dec 15 16:14:17.711109 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 540/1030] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:17 2021] GET /compute/v2.1/servers/854116b0-a886-4d4c-84c4-092c1f46b5dc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:14:21.407032 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-b4fbba0a-ca65-44c7-83c3-f163f190e05b req-0a32c731-a289-41a2-abf9-664af2808d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:21.408531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:21.408531 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:14:21.412299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:21.412803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:21.423190 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.423655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.426469 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-b4fbba0a-ca65-44c7-83c3-f163f190e05b req-0a32c731-a289-41a2-abf9-664af2808d18 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.426963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-b4fbba0a-ca65-44c7-83c3-f163f190e05b req-0a32c731-a289-41a2-abf9-664af2808d18 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.428028 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.428464 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.453033 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-b4fbba0a-ca65-44c7-83c3-f163f190e05b req-0a32c731-a289-41a2-abf9-664af2808d18 service nova] Creating event network-changed:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:14:21.460060 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-b4fbba0a-ca65-44c7-83c3-f163f190e05b req-0a32c731-a289-41a2-abf9-664af2808d18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056499 Dec 15 16:14:21.460902 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 541/1031] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:21.498599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:21.629639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1a8c4bac-b746-447a-a6f3-38189ddfa1d1 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "DELETE /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 204 len: 0 microversion: 2.1 time: 0.229314 Dec 15 16:14:21.633568 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 491/1032] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:14:21 2021] DELETE /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:14:21.639718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:21.640656 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:21.650616 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.651357 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.652158 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:21.652595 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:21.835111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:21.843343 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a8d563d3-2f34-4c72-bd0f-d3574bd34b35 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1568 microversion: 2.1 time: 0.207859 Dec 15 16:14:21.844560 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 542/1033] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:21 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:22.862801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:22.863505 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:22.870586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:22.871049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:22.871839 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:22.872267 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:23.019189 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:23.026472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-cbe87c8f-9a6d-4334-bbbd-44e8bf857a11 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1449 microversion: 2.1 time: 0.169262 Dec 15 16:14:23.027047 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 492/1034] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:22 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:23.489145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0d62ee06-15b5-42eb-b597-06e347e7d1cd tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Action: 'create', calling method: .version_select at 0x7f0514257af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-403591407", "metadata": {"Type": "work"}}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:23.687400 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-fa85c234-2fe5-4f43-9da0-a010accb049c req-a11faddf-6b9a-4bab-86d8-a9bf18633505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41639b62-dff9-4f2d-9cf2-c84c363a775f", "name": "network-vif-deleted", "tag": "e59443c3-d7d5-4e2d-aff5-cef64eefe552"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:23.689625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:23.689625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:14:23.708350 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-fa85c234-2fe5-4f43-9da0-a010accb049c req-a11faddf-6b9a-4bab-86d8-a9bf18633505 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:23.708867 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-fa85c234-2fe5-4f43-9da0-a010accb049c req-a11faddf-6b9a-4bab-86d8-a9bf18633505 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:23.723281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-fa85c234-2fe5-4f43-9da0-a010accb049c req-a11faddf-6b9a-4bab-86d8-a9bf18633505 service nova] Creating event network-vif-deleted:e59443c3-d7d5-4e2d-aff5-cef64eefe552 for instance 41639b62-dff9-4f2d-9cf2-c84c363a775f on hv-cinder-80070 Dec 15 16:14:23.728697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-fa85c234-2fe5-4f43-9da0-a010accb049c req-a11faddf-6b9a-4bab-86d8-a9bf18633505 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045622 Dec 15 16:14:23.729492 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 493/1035] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:23.791010 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0d62ee06-15b5-42eb-b597-06e347e7d1cd tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.412200 Dec 15 16:14:23.791735 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 543/1036] 10.222.0.41 () {60 vars in 1155 bytes} [Wed Dec 15 16:14:23 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 16:14:23.803027 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5a0048f3-cf28-40b3-afaa-46542371bd61 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Calling method '.version_select at 0x7f0514146280>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:23.848735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5a0048f3-cf28-40b3-afaa-46542371bd61 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640" status: 200 len: 352 microversion: 2.1 time: 0.049657 Dec 15 16:14:23.849487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 494/1037] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:14:23 2021] GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:24.046996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:24.047703 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:24.066734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:24.067791 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:24.068853 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:24.069832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:24.108107 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:24.108558 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:24.109119 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lazy-loading 'fault' on Instance uuid 41639b62-dff9-4f2d-9cf2-c84c363a775f {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:14:24.156924 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '167f076ea79547b6b93b25b80d24330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79292acd0f5349ed8f0dc153ee4c983d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:24.165493 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ef4c7cdb-27e3-48bb-8923-676a22906f59 tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 200 len: 1224 microversion: 2.1 time: 0.123180 Dec 15 16:14:24.166378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 544/1038] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:24 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:24.861484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e4380adf-aa4d-4647-80e8-43b6bf5e4668 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Calling method '.version_select at 0x7f05142b3d30>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:24.905451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e4380adf-aa4d-4647-80e8-43b6bf5e4668 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640" status: 200 len: 353 microversion: 2.1 time: 0.048080 Dec 15 16:14:24.906006 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 495/1039] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:14:24 2021] GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:24.916930 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-d19ed1a8-1c9d-41de-a61a-f21e26bafaf6 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Calling method '.version_select at 0x7f05140d3d30>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:24.961788 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-d19ed1a8-1c9d-41de-a61a-f21e26bafaf6 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640" status: 200 len: 353 microversion: 2.1 time: 0.048379 Dec 15 16:14:24.962446 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 545/1040] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:14:24 2021] GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:24.978436 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b118e8d6-4953-4d12-b1bb-e05711ff6c86 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Calling method '.version_select at 0x7f0514193940>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:25.034398 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b118e8d6-4953-4d12-b1bb-e05711ff6c86 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640" status: 202 len: 0 microversion: 2.1 time: 0.058594 Dec 15 16:14:25.035001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 496/1041] 10.222.0.41 () {58 vars in 1247 bytes} [Wed Dec 15 16:14:24 2021] DELETE /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:25.042662 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-be87e9b7-65ee-45e4-9519-4b7bced80cb1 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Calling method '.version_select at 0x7f05141c3280>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:25.087381 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-be87e9b7-65ee-45e4-9519-4b7bced80cb1 tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640" status: 200 len: 352 microversion: 2.1 time: 0.048239 Dec 15 16:14:25.088061 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 546/1042] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:14:25 2021] GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640 => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:25.182111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:25.182859 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] [instance: 41639b62-dff9-4f2d-9cf2-c84c363a775f] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:25.189986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:25.189986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:25.190759 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:25.191191 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:25.206854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] HTTP exception thrown: Instance 41639b62-dff9-4f2d-9cf2-c84c363a775f could not be found. Dec 15 16:14:25.207439 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Returning 404 to user: Instance 41639b62-dff9-4f2d-9cf2-c84c363a775f could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:25.208253 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-12cd842a-a01c-4e79-a3c0-c02a743bb68f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f" status: 404 len: 111 microversion: 2.1 time: 0.029868 Dec 15 16:14:25.208789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 497/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:14:25 2021] GET /compute/v2.1/servers/41639b62-dff9-4f2d-9cf2-c84c363a775f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:25.362807 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6fe61077-16c0-4210-b283-d0d5dca1177f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] Calling method '.version_select at 0x7f051419c5e0>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:25.394561 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6fe61077-16c0-4210-b283-d0d5dca1177f tempest-TestShelveInstance-767617893 tempest-TestShelveInstance-767617893-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-693928270" status: 202 len: 0 microversion: 2.1 time: 0.035345 Dec 15 16:14:25.395152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 547/1044] 10.222.0.41 () {58 vars in 1250 bytes} [Wed Dec 15 16:14:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-693928270 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:14:26.100105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3e299f95-7551-4bde-b077-526d6dc1d44c tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Calling method '.version_select at 0x7f0514146d30>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:26.127567 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-3e299f95-7551-4bde-b077-526d6dc1d44c tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] HTTP exception thrown: Volume e66971ab-7caa-4dbe-901e-ccddd7fb6640 could not be found. Dec 15 16:14:26.128157 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3e299f95-7551-4bde-b077-526d6dc1d44c tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] Returning 404 to user: Volume e66971ab-7caa-4dbe-901e-ccddd7fb6640 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:26.129038 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3e299f95-7551-4bde-b077-526d6dc1d44c tempest-VolumesGetTestJSON-1155168421 tempest-VolumesGetTestJSON-1155168421-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640" status: 404 len: 109 microversion: 2.1 time: 0.033129 Dec 15 16:14:26.129572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 498/1045] 10.222.0.41 () {58 vars in 1244 bytes} [Wed Dec 15 16:14:26 2021] GET /compute/v2.1/os-volumes/e66971ab-7caa-4dbe-901e-ccddd7fb6640 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:29.053183 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:29.054083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:29.062402 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.062572 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.065223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.065690 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.101439 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0c9b73a8-fc20-484c-9d7b-62b429645bed tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053274 Dec 15 16:14:29.102011 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 548/1046] 10.222.0.41 () {60 vars in 1342 bytes} [Wed Dec 15 16:14:29 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:29.180279 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:29.360937 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:29.368280 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.368582 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.369370 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.370583 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.397312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Going to try to terminate instance {{(pid=116080) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:14:29.473070 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-c7f940a2-ebd6-499c-a887-d5f98f565639 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 204 len: 0 microversion: 2.20 time: 0.296534 Dec 15 16:14:29.473951 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 499/1047] 10.222.0.41 () {60 vars in 1279 bytes} [Wed Dec 15 16:14:29 2021] DELETE /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:14:29.482537 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:29.483137 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:29.489003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.489450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.490258 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:29.490687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:29.629896 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:29.637936 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:29.639494 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:29.640652 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-eac58f1f-40e8-4738-a835-309ebf7e8704 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.161994 Dec 15 16:14:29.641201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 549/1048] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:29 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:14:30.660735 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:30.661736 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:30.668576 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:30.669022 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:30.669803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:30.670268 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:31.446247 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:31.454242 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:31.456522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:31.457769 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8da8d1e7-152c-4f12-9b2b-1aaa5c2acb91 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1722 microversion: 2.20 time: 0.801704 Dec 15 16:14:31.458452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 500/1049] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:30 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1722 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:32.478078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:32.479383 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:32.488238 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:32.489636 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:32.490663 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:32.491257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:32.599587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:32.608206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:32.609995 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e70e00befa3d41d0b5949f99d36c9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f1638b13884efc82ff109ef86772d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:14:32.611677 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4997a628-d648-4cd0-89b8-09321bb63d38 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 200 len: 1655 microversion: 2.20 time: 0.138388 Dec 15 16:14:32.622614 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 550/1050] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:32 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:32.973325 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-3fbce572-cbd2-43df-a3cb-c8b5e56b0ba9 req-d33ad27c-f19a-40e8-bec3-2a13cd753319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252a5452-6ada-4537-ac76-03d697ce6d08", "name": "network-vif-deleted", "tag": "2aa9ba55-7099-4c77-96de-51fbd5b9bd0f"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:32.978272 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:32.978272 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:14:32.996982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-3fbce572-cbd2-43df-a3cb-c8b5e56b0ba9 req-d33ad27c-f19a-40e8-bec3-2a13cd753319 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:32.997339 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-3fbce572-cbd2-43df-a3cb-c8b5e56b0ba9 req-d33ad27c-f19a-40e8-bec3-2a13cd753319 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:33.033134 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-3fbce572-cbd2-43df-a3cb-c8b5e56b0ba9 req-d33ad27c-f19a-40e8-bec3-2a13cd753319 service nova] Creating event network-vif-deleted:2aa9ba55-7099-4c77-96de-51fbd5b9bd0f for instance 252a5452-6ada-4537-ac76-03d697ce6d08 on hv-cinder-80070 Dec 15 16:14:33.039445 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-3fbce572-cbd2-43df-a3cb-c8b5e56b0ba9 req-d33ad27c-f19a-40e8-bec3-2a13cd753319 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072747 Dec 15 16:14:33.048358 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 501/1051] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:14:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:33.630562 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:33.632207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:33.641958 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:33.643280 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:33.644316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:33.644986 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:33.686459 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] HTTP exception thrown: Instance 252a5452-6ada-4537-ac76-03d697ce6d08 could not be found. Dec 15 16:14:33.687051 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Returning 404 to user: Instance 252a5452-6ada-4537-ac76-03d697ce6d08 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:33.688068 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e74279fc-aa83-4926-828b-5ab518d9ee42 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 404 len: 111 microversion: 2.20 time: 0.061769 Dec 15 16:14:33.690012 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 551/1052] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:33 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:14:33.700042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a17c2fb7-2c9f-4556-a69d-8b78b4a8f443 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '.version_select at 0x7f051423db80>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:33.727409 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a17c2fb7-2c9f-4556-a69d-8b78b4a8f443 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627050039" status: 204 len: 0 microversion: 2.20 time: 0.031973 Dec 15 16:14:33.728417 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 502/1053] 10.222.0.41 () {60 vars in 1261 bytes} [Wed Dec 15 16:14:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627050039 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:14:36.418003 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:36.418698 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:36.425716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:36.426179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:36.426978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:36.427409 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:36.442644 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] HTTP exception thrown: Instance 252a5452-6ada-4537-ac76-03d697ce6d08 could not be found. Dec 15 16:14:36.443245 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Returning 404 to user: Instance 252a5452-6ada-4537-ac76-03d697ce6d08 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:36.444094 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9a685738-1b6e-4efd-8941-dce09892f7b1 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 404 len: 111 microversion: 2.20 time: 0.029853 Dec 15 16:14:36.444667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 552/1054] 10.222.0.41 () {60 vars in 1279 bytes} [Wed Dec 15 16:14:36 2021] DELETE /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 16:14:36.453366 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:36.454301 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 252a5452-6ada-4537-ac76-03d697ce6d08] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:36.460661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:36.461110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:36.461904 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:36.462368 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:36.476332 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] HTTP exception thrown: Instance 252a5452-6ada-4537-ac76-03d697ce6d08 could not be found. Dec 15 16:14:36.476941 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Returning 404 to user: Instance 252a5452-6ada-4537-ac76-03d697ce6d08 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:36.477774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-655323ee-7ae4-4da5-a8c8-5c3530a45df2 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08" status: 404 len: 111 microversion: 2.20 time: 0.028824 Dec 15 16:14:36.478387 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 503/1055] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:36 2021] GET /compute/v2.1/servers/252a5452-6ada-4537-ac76-03d697ce6d08 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 16:14:37.603821 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:37.604327 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:37.610544 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:37.610989 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:37.611750 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:37.612179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:37.625021 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] HTTP exception thrown: Instance 635372a5-622f-42d6-9723-ae9c21ad0a24 could not be found. Dec 15 16:14:37.625588 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Returning 404 to user: Instance 635372a5-622f-42d6-9723-ae9c21ad0a24 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:37.626414 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-73cffb0e-8498-4a3d-8169-dec05cd7eddf tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "DELETE /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 404 len: 111 microversion: 2.20 time: 0.026312 Dec 15 16:14:37.626932 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 553/1056] 10.222.0.41 () {60 vars in 1279 bytes} [Wed Dec 15 16:14:37 2021] DELETE /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:14:37.634652 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:37.635257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] [instance: 635372a5-622f-42d6-9723-ae9c21ad0a24] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:14:37.641398 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:37.641845 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:37.642642 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:14:37.643079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:14:37.656293 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] HTTP exception thrown: Instance 635372a5-622f-42d6-9723-ae9c21ad0a24 could not be found. Dec 15 16:14:37.656868 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] Returning 404 to user: Instance 635372a5-622f-42d6-9723-ae9c21ad0a24 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:37.657663 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-38c56d16-4a6e-4f25-b1a6-5398d0fc2d88 tempest-AttachVolumeShelveTestJSON-377083239 tempest-AttachVolumeShelveTestJSON-377083239-project] 10.222.0.41 "GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24" status: 404 len: 111 microversion: 2.20 time: 0.026823 Dec 15 16:14:37.658195 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 504/1057] 10.222.0.41 () {60 vars in 1276 bytes} [Wed Dec 15 16:14:37 2021] GET /compute/v2.1/servers/635372a5-622f-42d6-9723-ae9c21ad0a24 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:15:05.302565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:05.303135 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:05.308906 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:05.309350 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:05.310114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:05.310567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:05.335332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:15:05.419179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3c94dbb3-e9b9-4035-a60c-d5e4f57c10bc tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 204 len: 0 microversion: 2.1 time: 0.120711 Dec 15 16:15:05.419793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 554/1058] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:15:05 2021] DELETE /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:15:05.428860 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:05.429476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:05.435597 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:05.436046 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:05.436827 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:05.437270 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:05.571294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:05.578674 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9db00202-403a-44d0-b5c4-3e8330789297 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1578 microversion: 2.1 time: 0.154291 Dec 15 16:15:05.579234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 505/1059] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:05 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:06.595669 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:06.596353 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:06.602748 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:06.603194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:06.603959 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:06.604386 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:06.733338 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:06.741136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-ec5b3a45-8cfb-4f86-a190-a5e204934783 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1578 microversion: 2.1 time: 0.149465 Dec 15 16:15:06.741707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 555/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:06 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:07.758666 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:07.759271 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:07.765925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:07.766399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:07.767211 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:07.767643 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:07.897149 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:07.904405 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2e0df304-257e-4fd0-8980-6077c3d5bcc4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1578 microversion: 2.1 time: 0.149259 Dec 15 16:15:07.904954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 506/1061] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:07 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:08.921555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:08.922178 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:08.929004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.929448 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:08.930269 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:08.930707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:09.059389 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:09.067208 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0fb8bd22-1c47-46ed-8a58-09569c9b4968 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1578 microversion: 2.1 time: 0.149284 Dec 15 16:15:09.067775 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 556/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:08 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:10.084556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:10.085174 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:10.091260 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:10.091712 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:10.092491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:10.093115 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:10.230352 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:10.238981 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-9fa23b9a-8477-46ec-b77f-278de85ee29d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1578 microversion: 2.1 time: 0.158767 Dec 15 16:15:10.239547 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 507/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:10 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:11.256836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:11.257454 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:11.264150 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.273565 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.274688 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.275525 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.295356 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-de43ba87-c9f6-44f2-b719-364ba503d653 req-8506a567-64ba-4a0d-87d3-ad366e97e866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82dd27b-c17d-46b9-90ba-ac10e0df5039", "name": "network-vif-deleted", "tag": "ff8c60a3-47a7-4194-b028-2e81bba77d11"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:11.298087 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:11.298087 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:15:11.334555 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-de43ba87-c9f6-44f2-b719-364ba503d653 req-8506a567-64ba-4a0d-87d3-ad366e97e866 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:11.335233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-de43ba87-c9f6-44f2-b719-364ba503d653 req-8506a567-64ba-4a0d-87d3-ad366e97e866 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:11.362953 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-de43ba87-c9f6-44f2-b719-364ba503d653 req-8506a567-64ba-4a0d-87d3-ad366e97e866 service nova] Creating event network-vif-deleted:ff8c60a3-47a7-4194-b028-2e81bba77d11 for instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 on hv-cinder-80070 Dec 15 16:15:11.368620 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-de43ba87-c9f6-44f2-b719-364ba503d653 req-8506a567-64ba-4a0d-87d3-ad366e97e866 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077472 Dec 15 16:15:11.369811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 508/1064] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:11.433575 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:11.445903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-104bbc4c-7eb9-442c-b7f8-4dc2a9089c28 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 200 len: 1510 microversion: 2.1 time: 0.190914 Dec 15 16:15:11.464971 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 557/1065] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:11 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:12.473882 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:12.474605 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:12.481108 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:12.481561 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:12.482524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:12.483230 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:12.499802 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] HTTP exception thrown: Instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 could not be found. Dec 15 16:15:12.500631 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Returning 404 to user: Instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:15:12.501469 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-62d38ab2-ba48-451e-8430-b47b1efca94d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 404 len: 111 microversion: 2.1 time: 0.032823 Dec 15 16:15:12.502025 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 509/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:12 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:12.600469 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1530214978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1449079097", "security_groups": [{"name": "tempest-secgroup-smoke-1561118706"}], "block_device_mapping_v2": [{"uuid": "5f3dc29b-7649-4b3d-a030-e51ba44752ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6547453-c061-40ed-854e-81302323e81a"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:12.739376 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] validate_networks() for [('c6547453-c061-40ed-854e-81302323e81a', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:15:13.129158 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:15:13.129667 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:15:13.130398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:15:13.130885 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:15:13.131422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:15:13.140826 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.141194 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.142209 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:13.142650 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:13.160817 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:15:13.165920 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for user b3982f969a9948ba87a9acfe6b03d697 and project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:15:13.232976 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:15:13.235235 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f3dc29b-7649-4b3d-a030-e51ba44752ff',volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:15:13.368236 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f87c9100-f4bf-4931-848b-699a8986a089 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772935 Dec 15 16:15:13.368878 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 558/1067] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:15:12 2021] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:15:13.379603 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-319d6bef-79f5-4acf-b846-c6de213520e4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:13.380280 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-319d6bef-79f5-4acf-b846-c6de213520e4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:13.440920 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-319d6bef-79f5-4acf-b846-c6de213520e4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:13.444573 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-319d6bef-79f5-4acf-b846-c6de213520e4 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1095 microversion: 2.1 time: 0.069440 Dec 15 16:15:13.445200 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 510/1068] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:13 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:14.461763 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:14.463315 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:14.471899 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:14.472414 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:14.473322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:14.473758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:14.534452 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:14.542461 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-34a82b96-41e1-4abf-b991-72e19a712bb0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1211 microversion: 2.1 time: 0.085188 Dec 15 16:15:14.543054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 559/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:14 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:15.563341 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:15.564239 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:15.580262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.581647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.582764 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.583266 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.779519 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-caa19eb4-4d16-4104-b590-cdfc0e0bf45e req-941a9507-592f-4309-be75-412fe83ebb09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f641c8-2d03-4706-b1cb-ccccd3008fcd", "tag": "cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:15.782964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:15.782964 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:15:15.794360 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-caa19eb4-4d16-4104-b590-cdfc0e0bf45e req-941a9507-592f-4309-be75-412fe83ebb09 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:15.794834 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-caa19eb4-4d16-4104-b590-cdfc0e0bf45e req-941a9507-592f-4309-be75-412fe83ebb09 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:15.813824 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:15.821466 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-97a1aa49-7caa-44dd-b077-b38889c7f8fb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.263025 Dec 15 16:15:15.822039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 511/1070] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:15 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:15.831421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-caa19eb4-4d16-4104-b590-cdfc0e0bf45e req-941a9507-592f-4309-be75-412fe83ebb09 service nova] Creating event network-changed:cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef for instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd on hv-cinder-80070 Dec 15 16:15:15.837960 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-caa19eb4-4d16-4104-b590-cdfc0e0bf45e req-941a9507-592f-4309-be75-412fe83ebb09 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063568 Dec 15 16:15:15.838598 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 560/1071] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:16.838635 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:16.839238 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:16.847688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:16.847688 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:16.848002 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:16.848611 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:16.983063 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:16.990964 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1b9ae7b4-51dc-4b56-8396-b18f6f3453aa tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.155891 Dec 15 16:15:16.991513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 512/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:16 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:18.008411 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:18.009203 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:18.016420 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:18.016945 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:18.017795 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:18.018349 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:18.154313 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:18.162322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-9f81d5d9-b7fe-41e9-bc26-6c4a9f379441 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.158573 Dec 15 16:15:18.162891 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 561/1073] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:18 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:19.178784 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:19.179385 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:19.185840 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:19.186317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:19.187092 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:19.187524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:19.319854 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:19.328076 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5007d9c8-199a-4063-9172-e5ce4d1b3de8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.153324 Dec 15 16:15:19.328647 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 513/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:19 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:20.347418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:20.348094 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:20.355391 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.355867 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.356641 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.357073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.501963 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:20.509251 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-050519f2-e39a-4050-ae04-08e75dc4b42a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.166160 Dec 15 16:15:20.509746 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 562/1075] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:20 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:20.555676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1182309114", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "192452fe-59bc-4e74-84a3-f02605f2a8a1"}]}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:20.607042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] validate_networks() for [('192452fe-59bc-4e74-84a3-f02605f2a8a1', None, None, None, None, None)] {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:15:20.933092 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:15:20.933512 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:15:20.933977 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:15:20.934438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:15:20.934848 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:15:20.943308 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.943754 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.944543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:20.944970 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:20.961061 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Getting quotas for project 24ef7e8be4c74391b54f6ba8a4f40242. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:15:20.964944 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Getting quotas for user ee1855a607ff45548223aa8be27ec20b and project 24ef7e8be4c74391b54f6ba8a4f40242. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:15:20.975901 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:15:20.978130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:15:21.021035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3088bf90-a3fc-4e67-8515-7e558bb96801 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469035 Dec 15 16:15:21.021680 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 514/1076] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:15:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:15:21.031413 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-31d17833-e6e3-4541-b1be-84a9d927e55b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:21.032095 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-31d17833-e6e3-4541-b1be-84a9d927e55b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:21.087436 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-31d17833-e6e3-4541-b1be-84a9d927e55b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:21.093993 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-31d17833-e6e3-4541-b1be-84a9d927e55b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1219 microversion: 2.1 time: 0.066241 Dec 15 16:15:21.094972 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 563/1077] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:21 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:21.526280 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:21.526938 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:21.539650 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:21.540327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:21.541292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:21.542411 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:21.687130 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:21.694371 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-7803f8f9-6eac-40ef-881c-8b676467af0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.172368 Dec 15 16:15:21.694925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 515/1078] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:21 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:22.110593 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:22.111125 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:22.117347 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.117773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.118584 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.119025 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.179791 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:22.187054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f9ed21e8-27d1-4ad1-adfc-b032420b00f1 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1277 microversion: 2.1 time: 0.080251 Dec 15 16:15:22.187635 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 564/1079] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:22 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:22.711043 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:22.711648 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:22.717803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.718277 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.719049 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:22.719476 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:22.933317 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:22.944923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-62429712-e26b-40ba-986e-194431cb2c62 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.234516 Dec 15 16:15:22.944923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 516/1080] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:22 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:23.204285 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:23.204886 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:23.212271 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.212903 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.213894 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.214351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.255355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-01844f94-44b6-49ea-aa21-c5371d86204b req-b0b2f99f-27f5-4160-9245-942ca9af18e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2781db-e535-412c-9b18-80bca024ee7e", "tag": "2f0fd107-b6f6-456f-95f1-505328f04e3f"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:23.259493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:23.259493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:15:23.274005 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-01844f94-44b6-49ea-aa21-c5371d86204b req-b0b2f99f-27f5-4160-9245-942ca9af18e5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.274680 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-01844f94-44b6-49ea-aa21-c5371d86204b req-b0b2f99f-27f5-4160-9245-942ca9af18e5 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.289422 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-01844f94-44b6-49ea-aa21-c5371d86204b req-b0b2f99f-27f5-4160-9245-942ca9af18e5 service nova] Creating event network-changed:2f0fd107-b6f6-456f-95f1-505328f04e3f for instance 5e2781db-e535-412c-9b18-80bca024ee7e on hv-cinder-80070 Dec 15 16:15:23.299488 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-01844f94-44b6-49ea-aa21-c5371d86204b req-b0b2f99f-27f5-4160-9245-942ca9af18e5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047891 Dec 15 16:15:23.300160 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 517/1081] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:23.436595 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:23.445332 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2e86ae9d-78b1-4294-8df7-86d2ff204632 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.244740 Dec 15 16:15:23.445845 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 565/1082] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:23 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:23.959991 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:23.961012 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:23.968273 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.968809 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:23.969717 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:23.970314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.468757 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:24.469435 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:24.476510 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:24.476956 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.477741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:24.478202 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:24.526792 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:24.535661 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2e736804-1de3-47d0-a046-7788214d0597 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.580258 Dec 15 16:15:24.536698 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 518/1083] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:23 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:24.635734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:24.643106 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-46c79f81-44e1-4b32-a499-86396a7fed8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.184057 Dec 15 16:15:24.643722 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 566/1084] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:24 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:25.553372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:25.554629 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:25.564496 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.564951 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.565788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.566269 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.660726 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:25.661484 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:25.669026 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.669617 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.670454 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:25.671078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:25.700582 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:25.708844 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-f7c17fa5-85d0-4438-bbcd-85a5e69010b3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.159845 Dec 15 16:15:25.709415 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 519/1085] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:25 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:25.802999 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:25.810114 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-64d9554d-147a-4039-ba93-6006f326ab5e tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.153973 Dec 15 16:15:25.810708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 567/1086] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:25 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:26.725177 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:26.725778 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:26.732524 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.732999 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.733797 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.734393 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.833111 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:26.833709 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:26.840611 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.841324 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.842305 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:26.842917 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:26.886451 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:26.895996 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e427b7bd-e82e-4fb5-8c94-71f3712c41e6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.174974 Dec 15 16:15:26.896638 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 520/1087] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:26 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:26.994099 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:27.002041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-829a55ee-6823-41d7-9a0c-51c1547fc37b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.179009 Dec 15 16:15:27.002659 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 568/1088] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:26 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:27.102619 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-d71df746-855b-4a3e-a8dc-36d104df7135 req-ee10260e-4c9d-46db-bb1d-6cadfb5d4bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f641c8-2d03-4706-b1cb-ccccd3008fcd", "name": "network-vif-plugged", "status": "completed", "tag": "cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:27.104298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:27.104298 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:15:27.116988 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-d71df746-855b-4a3e-a8dc-36d104df7135 req-ee10260e-4c9d-46db-bb1d-6cadfb5d4bb1 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:27.117982 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-d71df746-855b-4a3e-a8dc-36d104df7135 req-ee10260e-4c9d-46db-bb1d-6cadfb5d4bb1 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:27.134686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-d71df746-855b-4a3e-a8dc-36d104df7135 req-ee10260e-4c9d-46db-bb1d-6cadfb5d4bb1 service nova] Creating event network-vif-plugged:cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef for instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd on hv-cinder-80070 Dec 15 16:15:27.141184 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-d71df746-855b-4a3e-a8dc-36d104df7135 req-ee10260e-4c9d-46db-bb1d-6cadfb5d4bb1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042654 Dec 15 16:15:27.142315 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 521/1089] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:27.912712 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:27.913307 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:27.919476 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:27.919915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:27.920684 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:27.921110 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:28.020399 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:28.021095 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:28.027441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:28.027887 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:28.031360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:28.031360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:28.055215 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:28.063752 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-15b90ed3-c5e3-4900-b27a-5f71620b8e2e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1267 microversion: 2.1 time: 0.154567 Dec 15 16:15:28.064335 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 569/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:27 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:28.165155 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:28.172644 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a237e8ef-1033-4270-a16c-8b409211f612 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.156994 Dec 15 16:15:28.173213 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 522/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:28 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:29.080206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:29.080757 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:29.086949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.087390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.088152 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.088580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.159479 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-8b5bf354-55e0-4f2f-a456-2ea1993b3c05 req-99861780-df09-4be4-bdbe-82e0000f06df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2781db-e535-412c-9b18-80bca024ee7e", "name": "network-vif-plugged", "status": "completed", "tag": "2f0fd107-b6f6-456f-95f1-505328f04e3f"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:29.162128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:29.162128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:15:29.169554 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-8b5bf354-55e0-4f2f-a456-2ea1993b3c05 req-99861780-df09-4be4-bdbe-82e0000f06df service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.170352 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-8b5bf354-55e0-4f2f-a456-2ea1993b3c05 req-99861780-df09-4be4-bdbe-82e0000f06df service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.184026 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-8b5bf354-55e0-4f2f-a456-2ea1993b3c05 req-99861780-df09-4be4-bdbe-82e0000f06df service nova] Creating event network-vif-plugged:2f0fd107-b6f6-456f-95f1-505328f04e3f for instance 5e2781db-e535-412c-9b18-80bca024ee7e on hv-cinder-80070 Dec 15 16:15:29.188753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-8b5bf354-55e0-4f2f-a456-2ea1993b3c05 req-99861780-df09-4be4-bdbe-82e0000f06df service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034191 Dec 15 16:15:29.189340 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 523/1092] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:15:29.194501 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:29.195180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:29.201185 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.201628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.202513 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.203048 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.236452 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:29.245252 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a00d2827-f74a-431c-af08-bb62076bf687 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1454 microversion: 2.1 time: 0.168740 Dec 15 16:15:29.246108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 570/1093] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:29 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:29.263151 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:29.264151 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:29.270754 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.271708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.273482 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:29.273988 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:29.368239 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:29.376498 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-86a82c3f-c11f-4477-bc52-e67b12213724 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.186001 Dec 15 16:15:29.377111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 524/1094] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:29 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:29.416120 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:29.423320 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-10f39d39-834c-4311-92dd-e970b7566fd8 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1454 microversion: 2.1 time: 0.164788 Dec 15 16:15:29.423887 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 571/1095] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:29 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:30.393603 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:30.394314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:30.401517 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:30.401966 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:30.402986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:30.403360 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:30.659814 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:30.667452 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e21a1620-25c8-4aed-a1e1-4e16c87e6298 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1319 microversion: 2.1 time: 0.278438 Dec 15 16:15:30.668018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 525/1096] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:30 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:15:31.077855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-946b800f-9720-448c-854a-f76d8bc60321 req-b200665b-beff-499f-b19f-48bb691abb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f641c8-2d03-4706-b1cb-ccccd3008fcd", "tag": "cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:31.079773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:15:31.079773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:15:31.086954 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-946b800f-9720-448c-854a-f76d8bc60321 req-b200665b-beff-499f-b19f-48bb691abb4b service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:31.087466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-946b800f-9720-448c-854a-f76d8bc60321 req-b200665b-beff-499f-b19f-48bb691abb4b service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:31.098655 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-946b800f-9720-448c-854a-f76d8bc60321 req-b200665b-beff-499f-b19f-48bb691abb4b service nova] Creating event network-changed:cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef for instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd on hv-cinder-80070 Dec 15 16:15:31.103556 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-946b800f-9720-448c-854a-f76d8bc60321 req-b200665b-beff-499f-b19f-48bb691abb4b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030115 Dec 15 16:15:31.104149 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 572/1097] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:15:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:31.684616 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:31.685148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:31.691684 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:31.692233 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:31.693059 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:31.693587 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:31.825674 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:15:31.833636 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0a00ac23-2f84-4585-be48-4ab24aca4ffc tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1507 microversion: 2.1 time: 0.152781 Dec 15 16:15:31.834413 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 526/1098] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:15:31 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:54.232869 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5b10ba2-0ddd-47f4-9c02-37603d2b2e88", "device": "/dev/sdb"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:54.234618 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:15:54.240664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:54.241101 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:54.241871 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:15:54.242371 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:15:54.489249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-68b25adf-e9f1-41a1-8c55-78295c70ad9b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "POST /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260813 Dec 15 16:15:54.489968 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 573/1099] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:15:54 2021] POST /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:15.582116 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1969139787", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452"}} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:15.630267 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.network.neutron [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] validate_networks() for None {{(pid=116080) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:16:15.894689 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Flavor limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:16:15.895105 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Image limits 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:16:15.895571 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Flavor pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:16:15.895977 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Image pref 0:0:0 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:16:15.896379 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.virt.hardware [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:16:15.905098 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:15.905541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:15.906641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:15.907065 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:15.923327 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Getting quotas for project 0a49b052867b46fdb9c2984f78524817. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:16:15.927732 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.quota [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Getting quotas for user 355831df0e8047f98bcb3ebacdbb4fbd and project 0a49b052867b46fdb9c2984f78524817. Resources: {'cores', 'ram', 'instances'} {{(pid=116080) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:16:15.940042 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Going to run 1 instances... {{(pid=116080) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:16:15.942323 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:16:15.986596 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-317e4aeb-6ef0-4f85-b322-f13fed904eed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.407957 Dec 15 16:16:15.987232 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 527/1100] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:16:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:16:15.998444 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-42ca54f1-b3ea-45b7-b190-b97272e591b0 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:15.999206 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-42ca54f1-b3ea-45b7-b190-b97272e591b0 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:16.055863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-42ca54f1-b3ea-45b7-b190-b97272e591b0 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:16.064080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-42ca54f1-b3ea-45b7-b190-b97272e591b0 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1215 microversion: 2.1 time: 0.070145 Dec 15 16:16:16.064654 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 574/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:15 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:16.983931 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:16.985180 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:16.992491 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:16.993066 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:16.993918 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:16.994542 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:17.077858 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lazy-loading 'services' on Instance uuid 5e2781db-e535-412c-9b18-80bca024ee7e {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:16:17.081798 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:17.082948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:17.090385 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:17.090836 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:17.091620 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:17.092054 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:17.156463 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:17.157754 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8620ec17-e8dd-4851-a98d-2b2e4295e923 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e/os-volume_attachments/e5b10ba2-0ddd-47f4-9c02-37603d2b2e88" status: 202 len: 0 microversion: 2.1 time: 0.177210 Dec 15 16:16:17.158585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 528/1102] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:16:16 2021] DELETE /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e/os-volume_attachments/e5b10ba2-0ddd-47f4-9c02-37603d2b2e88 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:16:17.166250 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c249af71-24a5-4191-8752-03e2446cf281 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1273 microversion: 2.1 time: 0.088054 Dec 15 16:16:17.167220 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 575/1103] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:17 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:18.184826 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:18.186210 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:18.192590 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.193034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.194101 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.195344 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.285426 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:18.286085 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:18.293083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.293603 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.294501 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.295154 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.322191 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:16:18.410280 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-66d9c667-3076-47c7-8d3d-45e0d0e473a9 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 204 len: 0 microversion: 2.1 time: 0.128644 Dec 15 16:16:18.411092 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 576/1104] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:16:18 2021] DELETE /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:16:18.418020 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-4da7440e-c233-496d-9bb1-cdaa9646c9f4 req-ba634e18-ad7a-40d5-879d-529d9d5978c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66847e3e-ebd0-495f-aad5-85e8afdee139", "tag": "3f061558-8b50-4620-b235-b764026c44a6"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:18.419692 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:18.419692 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:16:18.427346 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-4da7440e-c233-496d-9bb1-cdaa9646c9f4 req-ba634e18-ad7a-40d5-879d-529d9d5978c7 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.427849 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-4da7440e-c233-496d-9bb1-cdaa9646c9f4 req-ba634e18-ad7a-40d5-879d-529d9d5978c7 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.440580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-4da7440e-c233-496d-9bb1-cdaa9646c9f4 req-ba634e18-ad7a-40d5-879d-529d9d5978c7 service nova] Creating event network-changed:3f061558-8b50-4620-b235-b764026c44a6 for instance 66847e3e-ebd0-495f-aad5-85e8afdee139 on hv-cinder-80070 Dec 15 16:16:18.445915 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-4da7440e-c233-496d-9bb1-cdaa9646c9f4 req-ba634e18-ad7a-40d5-879d-529d9d5978c7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033701 Dec 15 16:16:18.446547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 577/1105] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:18.451625 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:18.452314 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:18.458374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.458824 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.460255 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:18.460863 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:18.461676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:18.471096 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-fec83b6b-b5df-474e-862d-08c04426ca7b tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.290838 Dec 15 16:16:18.471788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 529/1106] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:18 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:18.607652 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:18.615334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c2279b3d-5c21-452d-95a5-a33e8d5f7b8b tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1513 microversion: 2.1 time: 0.167619 Dec 15 16:16:18.616073 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 578/1107] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:18 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:19.488016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:19.488628 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:19.494943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:19.495460 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:19.496250 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:19.496681 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:19.632716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:19.633315 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:19.639703 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:19.640145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:19.640909 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:19.641337 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:19.668912 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:19.676209 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e6f5713b-d735-4257-8a76-72bb3559a829 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.191931 Dec 15 16:16:19.676778 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 530/1108] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:19 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:19.769637 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:19.776934 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fc4f6728-e91a-433f-9712-234406b18be6 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1513 microversion: 2.1 time: 0.148601 Dec 15 16:16:19.777502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 579/1109] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:19 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:20.693469 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:20.694656 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:20.700782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.701230 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.701997 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.702461 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.794145 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:20.794775 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:20.801374 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.802043 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.802872 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.803872 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.871727 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:20.879148 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0b496c97-095e-489c-bcbc-d2dc79a9ec8d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 200 len: 1471 microversion: 2.1 time: 0.089041 Dec 15 16:16:20.890141 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 580/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:20 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 1471 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:20.895157 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-0e5813bd-7727-4d7c-9069-23150b156a35 req-a0854846-4000-40c7-a3bc-581a56f139a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2781db-e535-412c-9b18-80bca024ee7e", "name": "network-vif-deleted", "tag": "2f0fd107-b6f6-456f-95f1-505328f04e3f"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:20.897928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:20.897928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:16:20.900073 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:20.905539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-0e5813bd-7727-4d7c-9069-23150b156a35 req-a0854846-4000-40c7-a3bc-581a56f139a0 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:20.906257 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-0e5813bd-7727-4d7c-9069-23150b156a35 req-a0854846-4000-40c7-a3bc-581a56f139a0 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:20.908131 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-92a856e0-98d0-4678-9117-982259d61be8 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.218507 Dec 15 16:16:20.918216 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 531/1111] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:20 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:20.918995 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-0e5813bd-7727-4d7c-9069-23150b156a35 req-a0854846-4000-40c7-a3bc-581a56f139a0 service nova] Creating event network-vif-deleted:2f0fd107-b6f6-456f-95f1-505328f04e3f for instance 5e2781db-e535-412c-9b18-80bca024ee7e on hv-cinder-80070 Dec 15 16:16:20.924488 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-0e5813bd-7727-4d7c-9069-23150b156a35 req-a0854846-4000-40c7-a3bc-581a56f139a0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032643 Dec 15 16:16:20.925078 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 581/1112] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:21.897046 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:21.897641 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 5e2781db-e535-412c-9b18-80bca024ee7e] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:21.903890 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:21.904328 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:21.905089 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:21.905515 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:21.918389 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] HTTP exception thrown: Instance 5e2781db-e535-412c-9b18-80bca024ee7e could not be found. Dec 15 16:16:21.918967 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Returning 404 to user: Instance 5e2781db-e535-412c-9b18-80bca024ee7e could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:16:21.919762 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-8a23983e-98e7-4360-a68b-ae96f0495302 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e" status: 404 len: 111 microversion: 2.1 time: 0.026399 Dec 15 16:16:21.920309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 532/1113] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:21 2021] GET /compute/v2.1/servers/5e2781db-e535-412c-9b18-80bca024ee7e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:21.925102 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:21.925710 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:21.932671 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:21.933224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:21.934136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:21.934351 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:22.069502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:22.080459 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c423aaad-d5cb-4e7b-9e01-f7f147564aca tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.159415 Dec 15 16:16:22.081745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 582/1114] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:21 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:23.098314 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:23.098972 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:23.104752 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:23.105212 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:23.105976 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:23.106438 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:23.232704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:23.239855 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-79854ea4-81b9-42d3-97df-db89eccbb483 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.145599 Dec 15 16:16:23.240412 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 533/1115] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:23 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:24.257822 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:24.258478 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:24.264699 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:24.265144 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:24.265911 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:24.266386 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:24.397312 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:24.404540 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-61561021-a6fe-451e-84a5-6ec1c7394bed tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.151172 Dec 15 16:16:24.405108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 583/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:24 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:25.121062 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-6ecc0639-468c-478f-bebe-e5206296f639 req-afe27aa1-bba1-4011-9730-cf97f1604a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66847e3e-ebd0-495f-aad5-85e8afdee139", "name": "network-vif-plugged", "status": "completed", "tag": "3f061558-8b50-4620-b235-b764026c44a6"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:25.122946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:25.122946 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:16:25.130299 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6ecc0639-468c-478f-bebe-e5206296f639 req-afe27aa1-bba1-4011-9730-cf97f1604a2f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:25.130745 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6ecc0639-468c-478f-bebe-e5206296f639 req-afe27aa1-bba1-4011-9730-cf97f1604a2f service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:25.143410 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-6ecc0639-468c-478f-bebe-e5206296f639 req-afe27aa1-bba1-4011-9730-cf97f1604a2f service nova] Creating event network-vif-plugged:3f061558-8b50-4620-b235-b764026c44a6 for instance 66847e3e-ebd0-495f-aad5-85e8afdee139 on hv-cinder-80070 Dec 15 16:16:25.148975 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-6ecc0639-468c-478f-bebe-e5206296f639 req-afe27aa1-bba1-4011-9730-cf97f1604a2f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Dec 15 16:16:25.149986 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 534/1117] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:25.420913 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:25.421515 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:25.428764 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:25.429223 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:25.430040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:25.430513 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:25.568847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:25.576170 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-4ca6cef7-0185-4d97-8b08-5a4af74d65d7 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1315 microversion: 2.1 time: 0.159266 Dec 15 16:16:25.576746 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 584/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:25 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:26.593578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:26.594309 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:26.601407 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.601860 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.602673 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.603112 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.731572 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:26.738944 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-27033a47-2cbe-4064-84fe-9ce0a9b957db tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1465 microversion: 2.1 time: 0.149864 Dec 15 16:16:26.739519 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 535/1119] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:26 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1465 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:26.776249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:26.776757 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:26.783294 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.783741 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.784513 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.785002 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.808873 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:16:26.879559 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-f40f4f14-17b5-4fce-acb3-7c9262c310ac tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "DELETE /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 204 len: 0 microversion: 2.1 time: 0.107347 Dec 15 16:16:26.880259 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 585/1120] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:16:26 2021] DELETE /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:16:26.890801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:26.891416 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:26.897932 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.898408 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:26.899187 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:26.899629 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:27.028525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:27.036117 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-06a6b5ac-d7a5-47cd-873a-9ee72e3f362c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1471 microversion: 2.1 time: 0.149876 Dec 15 16:16:27.036676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 536/1121] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:26 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:28.054642 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:28.055334 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:28.061566 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:28.062009 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:28.062822 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:28.063249 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:28.189852 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:28.197706 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-e96516c6-e1cc-4165-8f78-69b5056e83df tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1471 microversion: 2.1 time: 0.147670 Dec 15 16:16:28.198286 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 586/1122] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:28 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:29.214365 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:29.214963 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:29.221141 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:29.221584 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:29.222373 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:29.222804 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:29.348310 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:29.356872 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-61f96519-fdd5-4549-bf28-c78992ba3bea tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1471 microversion: 2.1 time: 0.145996 Dec 15 16:16:29.357514 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 537/1123] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:29 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:29.694844 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2040938138", "imageRef": "65f099b9-7d7a-47c6-81cf-19e1a6efe7ef", "flavorRef": "452", "networks": [{"uuid": "192452fe-59bc-4e74-84a3-f02605f2a8a1"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:29.745004 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] validate_networks() for [('192452fe-59bc-4e74-84a3-f02605f2a8a1', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:16:30.078567 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:16:30.078988 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:16:30.079462 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:16:30.079882 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:16:30.080272 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:16:30.089379 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.089825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.090668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.091100 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.107653 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Getting quotas for project 24ef7e8be4c74391b54f6ba8a4f40242. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:16:30.111422 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Getting quotas for user ee1855a607ff45548223aa8be27ec20b and project 24ef7e8be4c74391b54f6ba8a4f40242. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:16:30.121832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:16:30.124123 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65f099b9-7d7a-47c6-81cf-19e1a6efe7ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:16:30.169057 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8168116b-493d-447e-9f92-a0b374d814df tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478505 Dec 15 16:16:30.169707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 587/1124] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:16:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:16:30.179471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-32d780de-c76a-4f13-93f7-2d93fb3fdea4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:30.180059 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-32d780de-c76a-4f13-93f7-2d93fb3fdea4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:30.231204 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-32d780de-c76a-4f13-93f7-2d93fb3fdea4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:30.237593 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-32d780de-c76a-4f13-93f7-2d93fb3fdea4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1219 microversion: 2.1 time: 0.061910 Dec 15 16:16:30.238150 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 538/1125] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:30 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:30.378687 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:30.379295 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:30.385316 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.385758 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.386557 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:30.387016 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:30.524637 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:30.532471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-547ff1ad-7c8d-4dce-9093-4f9219214b87 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1471 microversion: 2.1 time: 0.157346 Dec 15 16:16:30.533133 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 588/1126] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:30 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:31.254110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:31.254833 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:31.262001 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.262481 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.263369 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.263693 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.336148 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:31.343289 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-76b7bdf8-4a66-4ec8-9fb2-c53c22c1f285 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1277 microversion: 2.1 time: 0.092803 Dec 15 16:16:31.343853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 539/1127] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:31 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:31.554929 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:31.563617 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:31.571718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.572421 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.573383 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.573975 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.578595 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-888fce2f-da98-4eae-8a28-45924e7480bc req-4145d99b-ce81-4ef4-8f16-39dcd8a08b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66847e3e-ebd0-495f-aad5-85e8afdee139", "name": "network-vif-deleted", "tag": "3f061558-8b50-4620-b235-b764026c44a6"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:31.581556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:31.581556 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:16:31.592789 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-888fce2f-da98-4eae-8a28-45924e7480bc req-4145d99b-ce81-4ef4-8f16-39dcd8a08b5a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:31.593268 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-888fce2f-da98-4eae-8a28-45924e7480bc req-4145d99b-ce81-4ef4-8f16-39dcd8a08b5a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:31.606902 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-888fce2f-da98-4eae-8a28-45924e7480bc req-4145d99b-ce81-4ef4-8f16-39dcd8a08b5a service nova] Creating event network-vif-deleted:3f061558-8b50-4620-b235-b764026c44a6 for instance 66847e3e-ebd0-495f-aad5-85e8afdee139 on hv-cinder-80070 Dec 15 16:16:31.612460 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-888fce2f-da98-4eae-8a28-45924e7480bc req-4145d99b-ce81-4ef4-8f16-39dcd8a08b5a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041430 Dec 15 16:16:31.614018 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 540/1128] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:31.652378 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '355831df0e8047f98bcb3ebacdbb4fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a49b052867b46fdb9c2984f78524817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:31.665231 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-7c2393a8-2284-438e-a307-12648e13e509 tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 200 len: 1429 microversion: 2.1 time: 0.120169 Dec 15 16:16:31.666002 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 589/1129] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:31 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:32.361704 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:32.363014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:32.369493 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:32.369950 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:32.370761 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:32.371199 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:32.579285 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:32.587791 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-768c1573-910d-460a-809c-7d70ee25bec4 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1319 microversion: 2.1 time: 0.230597 Dec 15 16:16:32.588813 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 541/1130] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:32 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:32.682536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:32.683137 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] [instance: 66847e3e-ebd0-495f-aad5-85e8afdee139] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:32.689552 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:32.689994 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:32.690918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:32.691347 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:32.705173 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] HTTP exception thrown: Instance 66847e3e-ebd0-495f-aad5-85e8afdee139 could not be found. Dec 15 16:16:32.705766 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] Returning 404 to user: Instance 66847e3e-ebd0-495f-aad5-85e8afdee139 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:16:32.706622 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-c4a3e1dd-aa55-43f7-8afd-ea3f84715a7c tempest-VolumesNegativeTest-334749614 tempest-VolumesNegativeTest-334749614-project] 10.222.0.41 "GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139" status: 404 len: 111 microversion: 2.1 time: 0.027817 Dec 15 16:16:32.707199 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 590/1131] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:32 2021] GET /compute/v2.1/servers/66847e3e-ebd0-495f-aad5-85e8afdee139 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:33.604372 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:33.605014 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:33.611312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.611758 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.612610 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.612943 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.663405 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-3db5bb3c-324b-4e9d-9ede-6a72bb858734 req-eceec67f-162f-4f4d-aea5-866b0e4a4d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7591a5-ce47-4d9a-9a79-08170f2682ba", "tag": "312664fd-2a7f-4d09-989b-a786a42804cd"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:33.665080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:33.665080 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:16:33.672813 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-3db5bb3c-324b-4e9d-9ede-6a72bb858734 req-eceec67f-162f-4f4d-aea5-866b0e4a4d6d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:33.673484 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-3db5bb3c-324b-4e9d-9ede-6a72bb858734 req-eceec67f-162f-4f4d-aea5-866b0e4a4d6d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:33.688136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-3db5bb3c-324b-4e9d-9ede-6a72bb858734 req-eceec67f-162f-4f4d-aea5-866b0e4a4d6d service nova] Creating event network-changed:312664fd-2a7f-4d09-989b-a786a42804cd for instance 7e7591a5-ce47-4d9a-9a79-08170f2682ba on hv-cinder-80070 Dec 15 16:16:33.693495 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-3db5bb3c-324b-4e9d-9ede-6a72bb858734 req-eceec67f-162f-4f4d-aea5-866b0e4a4d6d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Dec 15 16:16:33.694105 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 591/1132] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:16:33.798118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:33.806676 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4ca28651-59e2-4ff1-9e2e-02f014cfcfc3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1319 microversion: 2.1 time: 0.205847 Dec 15 16:16:33.807252 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 542/1133] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:33 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:34.824961 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:34.825658 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:34.831809 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.832258 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.833041 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:34.833483 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:34.966674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:34.973945 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-77b137ff-2427-453d-8aad-3b4fa1f50498 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1319 microversion: 2.1 time: 0.153656 Dec 15 16:16:34.975066 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 592/1134] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:34 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:16:35.991853 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:35.992387 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:35.998811 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:35.999259 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.000031 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:36.000464 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:36.126723 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:36.133894 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-2e56d094-cd17-49b4-a351-b8289b440ad5 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1319 microversion: 2.1 time: 0.146384 Dec 15 16:16:36.134490 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 543/1135] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:35 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:37.150469 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:37.151083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:37.157568 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.158015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.158822 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.159265 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.294996 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:37.302398 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0c39d393-5aa7-4850-8149-aed5d1a8a12d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1319 microversion: 2.1 time: 0.155523 Dec 15 16:16:37.302966 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 593/1136] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:37 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:37.404123 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-e93bf60e-80a6-46a0-b7ee-0f5c8dae0699 req-aecb210a-f454-41ca-8e3f-076ae2c5bb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7591a5-ce47-4d9a-9a79-08170f2682ba", "name": "network-vif-plugged", "status": "completed", "tag": "312664fd-2a7f-4d09-989b-a786a42804cd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:37.405887 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:16:37.405887 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:16:37.414127 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-e93bf60e-80a6-46a0-b7ee-0f5c8dae0699 req-aecb210a-f454-41ca-8e3f-076ae2c5bb9e service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:37.414587 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-e93bf60e-80a6-46a0-b7ee-0f5c8dae0699 req-aecb210a-f454-41ca-8e3f-076ae2c5bb9e service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:37.426925 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-e93bf60e-80a6-46a0-b7ee-0f5c8dae0699 req-aecb210a-f454-41ca-8e3f-076ae2c5bb9e service nova] Creating event network-vif-plugged:312664fd-2a7f-4d09-989b-a786a42804cd for instance 7e7591a5-ce47-4d9a-9a79-08170f2682ba on hv-cinder-80070 Dec 15 16:16:37.432836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-e93bf60e-80a6-46a0-b7ee-0f5c8dae0699 req-aecb210a-f454-41ca-8e3f-076ae2c5bb9e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Dec 15 16:16:37.433454 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 544/1137] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:16:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:38.320240 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:38.320821 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:38.327103 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.327547 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.328310 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:38.328739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:38.454587 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:38.461769 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1900ce45-722c-419f-b333-6f95e4f9b4f2 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1319 microversion: 2.1 time: 0.145875 Dec 15 16:16:38.462362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 594/1138] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:38 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:39.479431 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:39.480114 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:39.486244 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.486691 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.487450 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.487881 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.617939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:39.625245 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0c0ef057-b309-4e17-a388-af7a33f10b7d tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1508 microversion: 2.1 time: 0.150506 Dec 15 16:16:39.625801 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 545/1139] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:39 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:16:39.641793 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03b70d28-5530-488d-ad60-d89b989c83df", "device": "/dev/sdb"}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:16:39.642900 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:39.648844 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.649290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.650061 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:39.650520 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:39.872685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-49ec78ac-ab9e-417b-96b0-32465d52d251 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "POST /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234592 Dec 15 16:16:39.873299 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 595/1140] 10.222.0.41 () {60 vars in 1322 bytes} [Wed Dec 15 16:16:39 2021] POST /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:16:57.994187 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:57.994828 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:58.001039 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:58.001477 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:58.002268 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:58.002694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:58.077432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lazy-loading 'services' on Instance uuid 7e7591a5-ce47-4d9a-9a79-08170f2682ba {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:16:58.143475 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-47c29477-fad3-4980-96a9-f561f1322063 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba/os-volume_attachments/03b70d28-5530-488d-ad60-d89b989c83df" status: 202 len: 0 microversion: 2.1 time: 0.153290 Dec 15 16:16:58.144284 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 546/1141] 10.222.0.41 () {58 vars in 1415 bytes} [Wed Dec 15 16:16:57 2021] DELETE /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba/os-volume_attachments/03b70d28-5530-488d-ad60-d89b989c83df => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:16:58.307395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:16:58.307973 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: Wed Dec 15 16:16:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:16:59.247156 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:59.247725 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:59.253737 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.254213 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.255017 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.255445 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.280908 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:16:59.352260 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-2b9cd851-8560-4579-9f66-4923fcaffd77 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 204 len: 0 microversion: 2.1 time: 0.109195 Dec 15 16:16:59.353066 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 596/1142] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:16:59 2021] DELETE /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:16:59.362079 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:16:59.362823 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:16:59.369303 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.369749 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.370557 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:16:59.370993 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:16:59.498312 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:16:59.505705 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-a1897dcb-ccfa-4fae-b99c-e78e667d29d3 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1514 microversion: 2.1 time: 0.147909 Dec 15 16:16:59.506292 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 547/1143] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:16:59 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:17:00.523481 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:00.524164 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:00.530685 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:00.531127 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:00.531905 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:00.532362 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:00.661449 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:00.669171 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-0f6c5a82-866c-4e03-aaab-44d31cb6e9ef tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1514 microversion: 2.1 time: 0.149784 Dec 15 16:17:00.669734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 597/1144] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:00 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:01.414772 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-9d8fd25f-89da-4a34-accd-1856c38a8e76 req-4789cec3-8353-4572-b3ab-ef501f07a0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7591a5-ce47-4d9a-9a79-08170f2682ba", "name": "network-vif-deleted", "tag": "312664fd-2a7f-4d09-989b-a786a42804cd"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:01.416376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:01.416376 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:17:01.423898 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-9d8fd25f-89da-4a34-accd-1856c38a8e76 req-4789cec3-8353-4572-b3ab-ef501f07a0e3 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:01.424346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-9d8fd25f-89da-4a34-accd-1856c38a8e76 req-4789cec3-8353-4572-b3ab-ef501f07a0e3 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:01.436118 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-9d8fd25f-89da-4a34-accd-1856c38a8e76 req-4789cec3-8353-4572-b3ab-ef501f07a0e3 service nova] Creating event network-vif-deleted:312664fd-2a7f-4d09-989b-a786a42804cd for instance 7e7591a5-ce47-4d9a-9a79-08170f2682ba on hv-cinder-80070 Dec 15 16:17:01.440955 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-9d8fd25f-89da-4a34-accd-1856c38a8e76 req-4789cec3-8353-4572-b3ab-ef501f07a0e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030436 Dec 15 16:17:01.441557 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 548/1145] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:01.686585 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:01.687219 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:01.693477 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:01.693925 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:01.694718 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:01.695160 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:01.725825 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:01.726290 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:01.726738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lazy-loading 'fault' on Instance uuid 7e7591a5-ce47-4d9a-9a79-08170f2682ba {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:17:01.770104 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1855a607ff45548223aa8be27ec20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ef7e8be4c74391b54f6ba8a4f40242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:01.778418 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-b7dc6c8d-43d4-4d30-beeb-433aa12603a0 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 200 len: 1309 microversion: 2.1 time: 0.095464 Dec 15 16:17:01.778982 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 598/1146] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:01 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:02.796727 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:02.797426 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] [instance: 7e7591a5-ce47-4d9a-9a79-08170f2682ba] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:02.803984 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:02.804437 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:02.805223 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:02.805660 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:02.819301 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] HTTP exception thrown: Instance 7e7591a5-ce47-4d9a-9a79-08170f2682ba could not be found. Dec 15 16:17:02.819820 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] Returning 404 to user: Instance 7e7591a5-ce47-4d9a-9a79-08170f2682ba could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:17:02.820644 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b8bffc25-ca79-4430-8c2f-f276a66fd198 tempest-VolumesSnapshotTestJSON-1291480266 tempest-VolumesSnapshotTestJSON-1291480266-project] 10.222.0.41 "GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba" status: 404 len: 111 microversion: 2.1 time: 0.027946 Dec 15 16:17:02.821188 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 549/1147] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:02 2021] GET /compute/v2.1/servers/7e7591a5-ce47-4d9a-9a79-08170f2682ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:17:20.862739 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2047827753", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1449079097", "security_groups": [{"name": "tempest-secgroup-smoke-1561118706"}], "block_device_mapping_v2": [{"uuid": "d9e04edc-9aad-4ed0-a8df-e2823b7b68b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6547453-c061-40ed-854e-81302323e81a"}]}} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:20.977253 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.network.neutron [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] validate_networks() for [('c6547453-c061-40ed-854e-81302323e81a', None, None, None, None, None)] {{(pid=116081) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:17:21.556855 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Flavor limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:17:21.557276 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Image limits 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:17:21.557817 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Flavor pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:17:21.558270 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Image pref 0:0:0 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:17:21.558680 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.virt.hardware [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:17:21.567302 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:21.568390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:21.569201 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:21.569630 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:21.585734 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:17:21.589634 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.quota [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Getting quotas for user b3982f969a9948ba87a9acfe6b03d697 and project 28eebd9de9a6480b8762cc5e77221f87. Resources: {'cores', 'ram', 'instances'} {{(pid=116081) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:17:21.643242 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Going to run 1 instances... {{(pid=116081) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:17:21.645393 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9e04edc-9aad-4ed0-a8df-e2823b7b68b0',volume_size=None,volume_type=None)] {{(pid=116081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:17:21.764928 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-95460c47-0dd3-45b9-82a7-61b6cf681546 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.905716 Dec 15 16:17:21.765490 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 599/1148] 10.222.0.41 () {60 vars in 1146 bytes} [Wed Dec 15 16:17:20 2021] POST /compute/v2.1/servers => generated 406 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:17:21.775340 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-75639750-3a04-476c-a6cc-60f53d270741 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:21.776034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-75639750-3a04-476c-a6cc-60f53d270741 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:22.272346 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-75639750-3a04-476c-a6cc-60f53d270741 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:22.278947 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-75639750-3a04-476c-a6cc-60f53d270741 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1095 microversion: 2.1 time: 0.507303 Dec 15 16:17:22.279782 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 550/1149] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:21 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1095 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:23.297308 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:23.299055 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:23.306314 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:23.306948 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:23.307925 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:23.308536 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:23.470823 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:23.481541 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-db8ae367-d13a-4c9b-a9d5-b06a75d45727 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.188353 Dec 15 16:17:23.482570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 600/1150] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:23 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:23.992338 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-05596ae2-6b56-4625-b84a-310017499b4c req-ea70b2bf-3565-4180-830b-53e9605c81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe54186-4d41-4915-ad52-634401d0cd05", "tag": "63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:23.997504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:23.997504 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:17:24.015836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-05596ae2-6b56-4625-b84a-310017499b4c req-ea70b2bf-3565-4180-830b-53e9605c81e3 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:24.016413 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-05596ae2-6b56-4625-b84a-310017499b4c req-ea70b2bf-3565-4180-830b-53e9605c81e3 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:24.030230 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-05596ae2-6b56-4625-b84a-310017499b4c req-ea70b2bf-3565-4180-830b-53e9605c81e3 service nova] Creating event network-changed:63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e for instance cfe54186-4d41-4915-ad52-634401d0cd05 on hv-cinder-80070 Dec 15 16:17:24.035923 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-05596ae2-6b56-4625-b84a-310017499b4c req-ea70b2bf-3565-4180-830b-53e9605c81e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050338 Dec 15 16:17:24.036836 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 551/1151] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:24.499633 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:24.500424 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:24.508395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:24.508900 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:24.509871 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:24.510408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:24.642471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:24.649858 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-68ecb425-8257-4747-affa-d2bc5e202cdb tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.154314 Dec 15 16:17:24.650473 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 601/1152] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:24 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:25.667954 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:25.668738 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:25.675432 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:25.675879 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:25.676671 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:25.677111 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:25.806690 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:25.814016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-3377e7e2-8d59-45ec-a433-e39297def14f tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.150761 Dec 15 16:17:25.814541 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 552/1153] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:25 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:26.831629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:26.832196 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:26.839598 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:26.840108 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:26.840897 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:26.841442 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:26.989125 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:26.996570 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-8017e2c9-b461-4654-99d9-a4280e0abc21 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.168976 Dec 15 16:17:26.997143 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 602/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:26 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:17:28.013184 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:28.013788 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:28.020034 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:28.020484 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:28.021262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:28.021706 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:28.153170 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:28.160566 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-567e6e94-7b9c-42ff-a8f9-7134b1702239 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.151154 Dec 15 16:17:28.161128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 553/1155] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:28 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:29.177264 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:29.178395 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:29.184664 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:29.185116 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:29.185883 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:29.186356 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:29.382136 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:29.389702 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-6d30d5fe-2139-42ae-91bc-a86219a04f0c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.216161 Dec 15 16:17:29.390390 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 603/1156] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:29 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:29.462414 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:17:29.462894 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: Wed Dec 15 16:17:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:17:30.406586 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:30.407182 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:30.413435 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:30.413882 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:30.414675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:30.415103 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:30.545998 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:30.553878 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-1ed49dc5-ad1f-4797-b88b-d274fe856361 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.151081 Dec 15 16:17:30.554468 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 554/1157] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:30 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:31.571055 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:31.571759 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:31.578506 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:31.578957 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:31.579738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:31.580236 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:31.714879 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:31.722179 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-3ac16bba-7dd3-4547-b5ff-edc3f36564f0 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.155313 Dec 15 16:17:31.722875 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 604/1158] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:31 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:32.738480 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:32.739082 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:32.745441 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:32.745883 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:32.746675 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:32.747108 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:32.876110 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:32.883393 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-5a641ae2-2fd3-4614-aa2d-180724e2f4db tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.148531 Dec 15 16:17:32.883957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 555/1159] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:32 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:33.681848 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-23932e00-a17f-489b-b591-ca44d8ae57fc req-204a4f7f-015c-4d86-9150-bf2c271476d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe54186-4d41-4915-ad52-634401d0cd05", "name": "network-vif-plugged", "status": "completed", "tag": "63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:33.683670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:33.683670 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:17:33.692918 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-23932e00-a17f-489b-b591-ca44d8ae57fc req-204a4f7f-015c-4d86-9150-bf2c271476d6 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.693360 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-23932e00-a17f-489b-b591-ca44d8ae57fc req-204a4f7f-015c-4d86-9150-bf2c271476d6 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:33.704708 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-23932e00-a17f-489b-b591-ca44d8ae57fc req-204a4f7f-015c-4d86-9150-bf2c271476d6 service nova] Creating event network-vif-plugged:63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e for instance cfe54186-4d41-4915-ad52-634401d0cd05 on hv-cinder-80070 Dec 15 16:17:33.710083 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-23932e00-a17f-489b-b591-ca44d8ae57fc req-204a4f7f-015c-4d86-9150-bf2c271476d6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Dec 15 16:17:33.710707 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 605/1160] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:17:33.900088 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:33.900694 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:33.907294 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.907747 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:33.908525 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:33.908957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:34.053181 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:34.060531 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-0e5e1f51-c957-4ea8-a3d3-5435a85264c6 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.164690 Dec 15 16:17:34.061284 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 556/1161] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:33 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:35.077676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:35.078408 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:35.085847 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:35.086681 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:35.087832 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:35.088282 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:35.237509 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:35.245039 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-a3bcd844-1171-407b-af0c-9f75e5846bff tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1267 microversion: 2.1 time: 0.171821 Dec 15 16:17:35.245617 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 606/1162] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:35 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:36.261592 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:36.262222 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:36.268543 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.268988 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.269765 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.270224 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.399194 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:36.406790 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-07066aa0-c5db-463a-ad25-7d3320d9489d tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1455 microversion: 2.1 time: 0.148881 Dec 15 16:17:36.407353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 557/1163] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:36 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:36.422973 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:36.424467 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:17:36.429792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.430273 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.431040 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:36.431466 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:36.562841 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:17:36.570189 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-fce0d2e0-4303-4cfa-aad0-1a4055b43ac9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1455 microversion: 2.1 time: 0.150820 Dec 15 16:17:36.570751 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 607/1164] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:17:36 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:38.128736 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-40055fce-48f5-4cef-93d1-2c9309636c0a req-16f34984-3b57-45d5-83cc-272e18c48128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe54186-4d41-4915-ad52-634401d0cd05", "tag": "63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:17:38.130262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:17:38.130262 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:17:38.137241 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-40055fce-48f5-4cef-93d1-2c9309636c0a req-16f34984-3b57-45d5-83cc-272e18c48128 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:17:38.137686 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-40055fce-48f5-4cef-93d1-2c9309636c0a req-16f34984-3b57-45d5-83cc-272e18c48128 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:17:38.149201 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-40055fce-48f5-4cef-93d1-2c9309636c0a req-16f34984-3b57-45d5-83cc-272e18c48128 service nova] Creating event network-changed:63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e for instance cfe54186-4d41-4915-ad52-634401d0cd05 on hv-cinder-80070 Dec 15 16:17:38.154477 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-40055fce-48f5-4cef-93d1-2c9309636c0a req-16f34984-3b57-45d5-83cc-272e18c48128 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029542 Dec 15 16:17:38.155257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 558/1165] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:05.046633 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:19:05.047353 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: Wed Dec 15 16:19:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:19:08.505983 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:08.506539 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:08.509753 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-3d40e43d-487e-440b-943d-5086b5da46da req-54ba4706-445b-4c97-a5ad-e8efb6e0ab30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe54186-4d41-4915-ad52-634401d0cd05", "tag": "63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:08.511561 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:08.511561 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:19:08.512591 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:08.513075 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:08.513866 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:08.514532 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:08.519447 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-3d40e43d-487e-440b-943d-5086b5da46da req-54ba4706-445b-4c97-a5ad-e8efb6e0ab30 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:08.519960 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-3d40e43d-487e-440b-943d-5086b5da46da req-54ba4706-445b-4c97-a5ad-e8efb6e0ab30 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:08.532355 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-3d40e43d-487e-440b-943d-5086b5da46da req-54ba4706-445b-4c97-a5ad-e8efb6e0ab30 service nova] Creating event network-changed:63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e for instance cfe54186-4d41-4915-ad52-634401d0cd05 on hv-cinder-80070 Dec 15 16:19:08.537742 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-3d40e43d-487e-440b-943d-5086b5da46da req-54ba4706-445b-4c97-a5ad-e8efb6e0ab30 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033934 Dec 15 16:19:08.538655 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 559/1166] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:19:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:08.541086 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:19:08.631636 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-1fbc8277-93e4-4e17-bf30-ffb4c3ab816c tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 204 len: 0 microversion: 2.1 time: 0.129298 Dec 15 16:19:08.632492 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 608/1167] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:19:08 2021] DELETE /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:19:08.642589 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:08.643295 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:08.649487 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:08.649935 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:08.650776 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:08.651222 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:08.873267 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:08.880812 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-4548fc7a-3125-4004-831c-27bb4204758e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1580 microversion: 2.1 time: 0.243536 Dec 15 16:19:08.881774 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 560/1168] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:08 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1580 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:09.898657 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:09.899352 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:09.901773 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2cdb172b-a6bf-4012-8a15-09f1707489a6] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 16:19:09.906502 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:09.906949 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:09.907723 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:09.908176 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:10.049910 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:10.057187 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5e90cf25-65f1-458b-bcd7-5f56a986dabf tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1461 microversion: 2.1 time: 0.163296 Dec 15 16:19:10.057755 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 609/1169] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:09 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1461 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:10.650889 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-6bb8a35b-1841-4390-be58-32722d79ecbe req-1552d445-8fc9-4192-abf5-97a19efaf62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe54186-4d41-4915-ad52-634401d0cd05", "name": "network-vif-deleted", "tag": "63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:10.652639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:10.652639 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:19:10.660177 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6bb8a35b-1841-4390-be58-32722d79ecbe req-1552d445-8fc9-4192-abf5-97a19efaf62d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:10.660618 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-6bb8a35b-1841-4390-be58-32722d79ecbe req-1552d445-8fc9-4192-abf5-97a19efaf62d service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:10.674142 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-6bb8a35b-1841-4390-be58-32722d79ecbe req-1552d445-8fc9-4192-abf5-97a19efaf62d service nova] Creating event network-vif-deleted:63cbf5ac-e2dd-47ce-a2b0-50c39f2df15e for instance cfe54186-4d41-4915-ad52-634401d0cd05 on hv-cinder-80070 Dec 15 16:19:10.679851 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-6bb8a35b-1841-4390-be58-32722d79ecbe req-1552d445-8fc9-4192-abf5-97a19efaf62d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Dec 15 16:19:10.680434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 561/1170] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:11.074095 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:11.074751 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:11.091606 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:11.092047 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:11.092811 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:11.093237 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:11.098814 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [-] [2cdb172b-a6bf-4012-8a15-09f1707489a6] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 45606. Dec 15 16:19:11.126177 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:11.126629 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:11.127064 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.objects.instance [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lazy-loading 'fault' on Instance uuid cfe54186-4d41-4915-ad52-634401d0cd05 {{(pid=116081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:19:11.166589 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:11.175477 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-5c645432-e6b4-49fe-88ad-4fe4f7701ed3 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 200 len: 1231 microversion: 2.1 time: 0.105019 Dec 15 16:19:11.175987 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 610/1171] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:11 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:12.193569 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:12.194281 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: cfe54186-4d41-4915-ad52-634401d0cd05] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:12.200374 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:12.200819 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:12.201585 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:12.202016 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:12.215807 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] HTTP exception thrown: Instance cfe54186-4d41-4915-ad52-634401d0cd05 could not be found. Dec 15 16:19:12.216393 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Returning 404 to user: Instance cfe54186-4d41-4915-ad52-634401d0cd05 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:19:12.217208 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-e891eecf-1f13-456e-bb07-f1a2777539c5 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05" status: 404 len: 111 microversion: 2.1 time: 0.028621 Dec 15 16:19:12.217734 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 562/1172] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:12 2021] GET /compute/v2.1/servers/cfe54186-4d41-4915-ad52-634401d0cd05 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:19:15.243574 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:15.244064 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:15.250471 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.250985 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.251674 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.252110 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.280828 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Going to try to terminate instance {{(pid=116081) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:19:15.371473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [req-44d580e0-6f00-4979-b92f-f434f3703085 req-ef384573-f9b1-4c11-a6fa-08631299846a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f641c8-2d03-4706-b1cb-ccccd3008fcd", "tag": "cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef"}]} {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:15.372957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:15.372957 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: warnings.warn(msg) Dec 15 16:19:15.378738 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-51f0a928-5bd7-4945-a9b4-40ed76051a17 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 204 len: 0 microversion: 2.1 time: 0.138698 Dec 15 16:19:15.382917 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-44d580e0-6f00-4979-b92f-f434f3703085 req-ef384573-f9b1-4c11-a6fa-08631299846a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.383352 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [req-44d580e0-6f00-4979-b92f-f434f3703085 req-ef384573-f9b1-4c11-a6fa-08631299846a service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.387015 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 611/1173] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:19:15 2021] DELETE /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:19:15.394674 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.compute.server_external_events [req-44d580e0-6f00-4979-b92f-f434f3703085 req-ef384573-f9b1-4c11-a6fa-08631299846a service nova] Creating event network-changed:cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef for instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd on hv-cinder-80070 Dec 15 16:19:15.395555 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:15.397193 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:15.400743 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [req-44d580e0-6f00-4979-b92f-f434f3703085 req-ef384573-f9b1-4c11-a6fa-08631299846a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157273 Dec 15 16:19:15.401617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 563/1174] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:19:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:15.404173 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.404792 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.405716 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:15.406279 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:15.545573 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.policy [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116081) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:15.558524 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-42a5bc41-4b97-4de4-9d7f-184cde94961e tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1578 microversion: 2.1 time: 0.167071 Dec 15 16:19:15.559224 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 612/1175] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:15 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:19:16.576838 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:16.577522 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:16.583599 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:16.584040 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:16.584803 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:16.585234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:16.724434 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:16.731924 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-afb1c0fd-f66b-466e-8cfe-67d8e0846e80 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1460 microversion: 2.1 time: 0.159591 Dec 15 16:19:16.732486 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 564/1176] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:16 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:17.415860 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [req-afbe3622-d0d6-4e9a-984c-f88f418beb49 req-d19c0d63-1868-46b6-a148-aac17d079217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f641c8-2d03-4706-b1cb-ccccd3008fcd", "name": "network-vif-deleted", "tag": "cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef"}]} {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:19:17.417665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:17.417665 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: warnings.warn(msg) Dec 15 16:19:17.425220 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-afbe3622-d0d6-4e9a-984c-f88f418beb49 req-d19c0d63-1868-46b6-a148-aac17d079217 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:17.425668 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [req-afbe3622-d0d6-4e9a-984c-f88f418beb49 req-d19c0d63-1868-46b6-a148-aac17d079217 service nova] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:17.438076 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.compute.server_external_events [req-afbe3622-d0d6-4e9a-984c-f88f418beb49 req-d19c0d63-1868-46b6-a148-aac17d079217 service nova] Creating event network-vif-deleted:cf0528e4-67d4-4a71-9ed8-15ddb20fd1ef for instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd on hv-cinder-80070 Dec 15 16:19:17.442635 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [req-afbe3622-d0d6-4e9a-984c-f88f418beb49 req-d19c0d63-1868-46b6-a148-aac17d079217 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031060 Dec 15 16:19:17.443410 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 613/1177] 10.222.0.41 () {64 vars in 1317 bytes} [Wed Dec 15 16:19:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:17.748698 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:17.749234 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:17.755808 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:17.756257 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:17.757035 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:17.757471 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:17.790020 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:17.790457 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:17.790912 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.objects.instance [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lazy-loading 'fault' on Instance uuid a4f641c8-2d03-4706-b1cb-ccccd3008fcd {{(pid=116080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:19:17.832473 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.policy [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3982f969a9948ba87a9acfe6b03d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eebd9de9a6480b8762cc5e77221f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116080) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:19:17.840794 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-17ded32b-75d0-4990-8c7c-320694b4f95a tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 200 len: 1231 microversion: 2.1 time: 0.095836 Dec 15 16:19:17.841492 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 565/1178] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:17 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:19:18.859220 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:18.859824 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: a4f641c8-2d03-4706-b1cb-ccccd3008fcd] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:18.866534 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:18.866978 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:18.867745 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:18.868174 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:18.880879 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] HTTP exception thrown: Instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd could not be found. Dec 15 16:19:18.881450 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Returning 404 to user: Instance a4f641c8-2d03-4706-b1cb-ccccd3008fcd could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:19:18.882277 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-58c805ed-ba95-4240-82f8-66e849433d51 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd" status: 404 len: 111 microversion: 2.1 time: 0.027657 Dec 15 16:19:18.882789 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 614/1179] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:18 2021] GET /compute/v2.1/servers/a4f641c8-2d03-4706-b1cb-ccccd3008fcd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:19:19.312768 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:19.313287 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.compute.api [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116080) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:19.320249 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:19.320697 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:19.321472 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:19.321939 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG oslo_concurrency.lockutils [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:19.334741 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.wsgi [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] HTTP exception thrown: Instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 could not be found. Dec 15 16:19:19.335322 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Returning 404 to user: Instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 could not be found. {{(pid=116080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:19:19.336128 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-b8d6ec08-eb06-481d-8f43-71ce1f2aa2ce tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 404 len: 111 microversion: 2.1 time: 0.027185 Dec 15 16:19:19.336645 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 566/1180] 10.222.0.41 () {58 vars in 1238 bytes} [Wed Dec 15 16:19:19 2021] DELETE /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:19:19.344676 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '>' {{(pid=116081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:19.345288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.compute.api [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] [instance: c82dd27b-c17d-46b9-90ba-ac10e0df5039] Fetching instance by UUID {{(pid=116081) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:19:19.351172 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:19.351624 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:19.352401 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:19.352838 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG oslo_concurrency.lockutils [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Lock "cda00ea0-fd54-437b-b7c8-456fcc486c03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116081) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:19.367288 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.wsgi [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] HTTP exception thrown: Instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 could not be found. Dec 15 16:19:19.367880 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: DEBUG nova.api.openstack.wsgi [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Returning 404 to user: Instance c82dd27b-c17d-46b9-90ba-ac10e0df5039 could not be found. {{(pid=116081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:19:19.368671 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO nova.api.openstack.requestlog [None req-60852439-c5be-4bc6-808d-089992c874b9 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039" status: 404 len: 111 microversion: 2.1 time: 0.027795 Dec 15 16:19:19.369195 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: [pid: 116081|app: 0|req: 615/1181] 10.222.0.41 () {58 vars in 1235 bytes} [Wed Dec 15 16:19:19 2021] GET /compute/v2.1/servers/c82dd27b-c17d-46b9-90ba-ac10e0df5039 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:19:20.638625 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: DEBUG nova.api.openstack.wsgi [None req-65e44afa-6c49-4b6e-b128-1d997d267fa1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] Calling method '.version_select at 0x7f051426fee0>' {{(pid=116080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:20.662992 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO nova.api.openstack.requestlog [None req-65e44afa-6c49-4b6e-b128-1d997d267fa1 tempest-TestVolumeBootPattern-1186632081 tempest-TestVolumeBootPattern-1186632081-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1449079097" status: 202 len: 0 microversion: 2.1 time: 0.027904 Dec 15 16:19:20.664023 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: [pid: 116080|app: 0|req: 567/1182] 10.222.0.41 () {58 vars in 1262 bytes} [Wed Dec 15 16:19:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1449079097 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:20:18.324580 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:20:18.325207 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: Wed Dec 15 16:20:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:22:23.712497 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:22:23.713064 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: Wed Dec 15 16:22:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:22:25.064526 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:22:25.065040 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: Wed Dec 15 16:22:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:22:29.483578 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:22:29.484132 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: Wed Dec 15 16:22:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:23:38.341563 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:23:38.342212 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: Wed Dec 15 16:23:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:24:18.839058 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:24:18.839617 dv-cinder-800703-3-iscsi devstack@n-api.service[116080]: Wed Dec 15 16:24:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:24:32.025322 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:24:32.025946 dv-cinder-800703-3-iscsi devstack@n-api.service[116081]: Wed Dec 15 16:24:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!